Pictorial depth cues elicit the perception of tridimensionality in dogs.

The perception of tridimensionality is elicited by binocular disparity, motion parallax, and monocular or pictorial cues. The perception of tridimensionality arising from pictorial cues has been investigated in several non-human animal species. Although dogs can use and discriminate bidimensional images, to date there is no evidence of dogs' ability to perceive tridimensionality in pictures and/or through pictorial cues. The aim of the present study was to assess the perception of tridimensionality in dogs elicited by two pictorial cues: linear perspective and shading. Thirty-two dogs were presented with a tridimensional stimulus (i.e., a ball) rolling onto a planar surface until eventually falling into a hole (control condition) or until reaching and rolling over an illusory hole (test condition). The illusory hole corresponded to the bidimensional pictorial representation of the real hole, in which the pictorial cues of shading and linear perspective created the impression of tridimensionality. In a violation of expectation paradigm, dogs showed a longer looking time at the scene in which the unexpected situation of a ball rolling over an illusory hole occurred. The surprise reaction observed in the test condition suggests that the pictorial cues of shading and linear perspective in the bidimensional image of the hole were able to elicit the perception of tridimensionality in dogs.

Context-based modulations of 3D vision are expertise dependent.

An object's identity can influence depth-position judgments. The mechanistic underpinnings underlying this phenomenon are largely unknown. Here, we asked whether context-dependent modulations of stereoscopic depth perception are expertise dependent. In 2 experiments, we tested whether training that attaches meaning (i.e. classification labels) to otherwise novel, stereoscopically presented objects changes observers' sensitivity for judging their depth position. In Experiment 1, observers were randomly assigned to 3 groups: a Greeble-classification training group, an orientation-discrimination training group, or a no-training group, and were tested on their stereoscopic depth sensitivity before and after training. In Experiment 2, participants were tested before and after training while fMRI responses were concurrently imaged. Behaviorally, stereoscopic performance was significantly better following Greeble-classification (but not orientation-discrimination, or no-) training. Using the fMRI data, we trained support vector machines to predict whether the data were from the pre- or post-training sessions. Results indicated that classification accuracies in V4 were higher for the Greeble-classification group as compared with the orientation-discrimination group for which accuracies were at chance level. Furthermore, classification accuracies in V4 were negatively correlated with response times for Greeble identification. We speculate that V4 is implicated in an expertise-dependent, object-tuning manner that allows it to better guide stereoscopic depth retrieval.

Contribution of the stereoscopic representation of motion-in-depth during visually guided feedback control.

Considerable studies have focused on the neural basis of visually guided tracking movement in the frontoparallel plane, whereas the neural process in real-world circumstances regarding the influence of binocular disparity and motion-in-depth (MID) perception is less understood. Although the role of stereoscopic versus monoscopic MID information has been extensively described for visual processing, its influence on top-down regulation for motor execution has not received much attention. Here, we orthogonally varied the visual representation (stereoscopic versus monoscopic) and motion direction (depth motion versus bias depth motion versus frontoparallel motion) during visually guided tracking movements, with simultaneous functional near-infrared spectroscopy recordings. Results show that the stereoscopic representation of MID could lead to more accurate movements, which was supported by specific neural activity pattern. More importantly, we extend prior evidence about the role of frontoparietal network in brain-behavior relationship, showing that occipital area, more specifically, visual area V2/V3 was also robustly involved in the association. Furthermore, by using the stereoscopic representation of MID, it is plausible to detect robust brain-behavior relationship even with small sample size at low executive task demand. Taken together, these findings highlight the importance of the stereoscopic representation of MID for investigating neural correlates of visually guided feedback control.

The geometry of the vergence-accommodation conflict in mixed reality systems.

Mixed reality technologies, such as virtual (VR) and augmented (AR) reality, present promising opportunities to advance education and professional training due to their adaptability to diverse contexts. Distortions in the perceived distance in such mediated conditions, however, are well documented and have imposed nontrivial challenges that complicate and limit transferring task performance in a virtual setting to the unmediated reality (UR). One potential source of the distance distortion is the vergence-accommodation conflict-the discrepancy between the depth specified by the eyes' accommodative state and the angle at which the eyes converge to fixate on a target. The present study involved the use of a manual pointing task in UR, VR, and AR to quantify the magnitude of the potential depth distortion in each modality. Conceptualizing the effect of vergence-accommodation offset as a constant offset to the vergence angle, a model was developed based on the stereoscopic viewing geometry. Different versions of the model were used to fit and predict the behavioral data for all modalities. Results confirmed the validity of the conceptualization of vergence-accommodation as a device-specific vergence offset, which predicted up to 66% of the variance in the data. The fitted parameters indicate that, due to the vergence-accommodation conflict, participants' vergence angle was driven outwards by approximately 0.2°, which disrupted the stereoscopic viewing geometry and produced distance distortion in VR and AR. The implications of this finding are discussed in the context of developing virtual environments that minimize the effect of depth distortion.

Task-specific employment of sensory signals underlies rapid task switching.

Much of our flexible behavior is dependent on responding efficiently to relevant information while discarding irrelevant information. Little is known, however, about how neural pathways governing sensory-motor associations can rapidly switch to accomplish such flexibility. Here, we addressed this question by electrically microstimulating middle temporal (MT) neurons selective for both motion direction and binocular disparity in monkeys switching between direction and depth discrimination tasks. Surprisingly, we frequently found that the observed psychophysical bias precipitated by delivering microstimulation to neurons whose preferred direction and depth were related to opposite choices in the two tasks was substantially shifted toward a specific movement. Furthermore, these effects correlated with behavioral switching performance. Our findings suggest that the outputs of sensory signals are task specific and that irrelevant sensory-motor pathways are gated depending on task demand so as to accomplish rapid attentional switching.

The box-circle illusion.

A novel geometrical optical illusion is reported in this article: the horizontal distances of the contextual structures distort the perceived vertical positions of observed objects. Specifically, the illusion manifests in the form of connected boxes of varying widths but equal heights, each containing a circle at the center. Despite identical vertical positioning of the circles, they appear misaligned. The illusion diminishes when the boxes are removed. Potential underlying mechanisms are discussed.

Efficient Stereo Depth Estimation for Pseudo-LiDAR: A Self-Supervised Approach Based on Multi-Input ResNet Encoder.

Perception and localization are essential for autonomous delivery vehicles, mostly estimated from 3D LiDAR sensors due to their precise distance measurement capability. This paper presents a strategy to obtain a real-time pseudo point cloud from image sensors (cameras) instead of laser-based sensors (LiDARs). Previous studies (such as PSMNet-based point cloud generation) built the algorithm based on accuracy but failed to operate in real time as LiDAR. We propose an approach to use different depth estimators to obtain pseudo point clouds similar to LiDAR to achieve better performance. Moreover, the depth estimator has used stereo imagery data to achieve more accurate depth estimation as well as point cloud results. Our approach to generating depth maps outperforms other existing approaches on KITTI depth prediction while yielding point clouds significantly faster than other approaches as well. Additionally, the proposed approach is evaluated on the KITTI stereo benchmark, where it shows effectiveness in runtime.

Visual Sensing and Depth Perception for Welding Robots and Their Industrial Applications.

With the rapid development of vision sensing, artificial intelligence, and robotics technology, one of the challenges we face is installing more advanced vision sensors on welding robots to achieve intelligent welding manufacturing and obtain high-quality welding components. Depth perception is one of the bottlenecks in the development of welding sensors. This review provides an assessment of active and passive sensing methods for depth perception and classifies and elaborates on the depth perception mechanisms based on monocular vision, binocular vision, and multi-view vision. It explores the principles and means of using deep learning for depth perception in robotic welding processes. Further, the application of welding robot visual perception in different industrial scenarios is summarized. Finally, the problems and countermeasures of welding robot visual perception technology are analyzed, and developments for the future are proposed. This review has analyzed a total of 2662 articles and cited 152 as references. The potential future research topics are suggested to include deep learning for object detection and recognition, transfer deep learning for welding robot adaptation, developing multi-modal sensor fusion, integrating models and hardware, and performing a comprehensive requirement analysis and system evaluation in collaboration with welding experts to design a multi-modal sensor fusion architecture.

Examining the Results of Virtual Reality-Based Egocentric Distance Estimation Tests Based on Immersion Level.

Depth perception as well as egocentric distance estimation can be trained in virtual spaces, although incorrect estimates can occur in these environments. To understand this phenomenon, a virtual environment with 11 changeable factors was created. Egocentric distance estimation skills of 239 participants were assessed with it in the range [25 cm, 160 cm]. One hundred fifty-seven people used a desktop display and seventy-two the Gear VR. According to the results, these investigated factors can have various effects combined with the two display devices on distance estimation and its time. Overall, desktop display users are more likely to accurately estimate or overestimate distances, and significant overestimations occur at 130 and 160 cm. With the Gear VR, distances in the range [40 cm, 130 cm] are significantly underestimated, while at 25 cm, they are significantly overestimated. Estimation times are significantly decreased with the Gear VR. When developing future virtual environments that require depth perception skills, developers should take these results into account.

AR visualizations in laparoscopy: surgeon preferences and depth assessment of vascular anatomy.

Introduction: This study compares five augmented reality (AR) vasculature visualization techniques in a mixed-reality laparoscopy simulator with 50 medical professionals and analyzes their impact on the surgeon. Material and methods: ​​The different visualization techniques' abilities to convey depth were measured using the participant's accuracy in an objective depth sorting task. Demographic data and subjective measures, such as the preference of each AR visualization technique and potential application areas, were collected with questionnaires. Results: Despite measuring differences in objective measurements across the visualization techniques, they were not statistically significant. In the subjective measures, however, 55% of the participants rated visualization technique II, 'Opaque with single-color Fresnel highlights', as their favorite. Participants felt that AR could be useful for various surgeries, especially complex surgeries (100%). Almost all participants agreed that AR could potentially improve surgical parameters, such as patient safety (88%), complication rate (84%), and identifying risk structures (96%). Conclusions: More studies are needed on the effect of different visualizations on task performance, as well as more sophisticated and effective visualization techniques for the operating room. With the findings of this study, we encourage the development of new study setups to advance surgical AR.

Ultra-High-Field Neuroimaging Reveals Fine-Scale Processing for 3D Perception.

Binocular disparity provides critical information about three-dimensional (3D) structures to support perception and action. In the past decade significant progress has been made in uncovering human brain areas engaged in the processing of binocular disparity signals. Yet, the fine-scale brain processing underlying 3D perception remains unknown. Here, we use ultra-high-field (7T) functional imaging at submillimeter resolution to examine fine-scale BOLD fMRI signals involved in 3D perception. In particular, we sought to interrogate the local circuitry involved in disparity processing by sampling fMRI responses at different positions relative to the cortical surface (i.e., across cortical depths corresponding to layers). We tested for representations related to 3D perception by presenting participants (male and female, N = 8) with stimuli that enable stable stereoscopic perception [i.e., correlated random dot stereograms (RDS)] versus those that do not (i.e., anticorrelated RDS). Using multivoxel pattern analysis (MVPA), we demonstrate cortical depth-specific representations in areas V3A and V7 as indicated by stronger pattern responses for correlated than for anticorrelated stimuli in upper rather than deeper layers. Examining informational connectivity, we find higher feedforward layer-to-layer connectivity for correlated than anticorrelated stimuli between V3A and V7. Further, we observe disparity-specific feedback from V3A to V1 and from V7 to V3A. Our findings provide evidence for the role of V3A as a key nexus for disparity processing, which is implicated in feedforward and feedback signals related to the perceptual estimation of 3D structures.SIGNIFICANCE STATEMENT Binocular vision plays a significant role in supporting our interactions with the surrounding environment. The fine-scale neural mechanisms that underlie the brain's skill in extracting 3D structures from binocular signals are poorly understood. Here, we capitalize on recent advances in ultra-high-field functional imaging to interrogate human brain circuits involved in 3D perception at submillimeter resolution. We provide evidence for the role of area V3A as a key nexus for disparity processing, which is implicated in feedforward and feedback signals related to the perceptual estimation of 3D structures from binocular signals. These fine-scale measurements help bridge the gap between animal neurophysiology and human fMRI studies investigating cross-scale circuits, from micro circuits to global brain networks for 3D perception.

Visual risk factors for falls in older adults: a case-control study.

BACKGROUND: Falls are the second leading cause of accidental deaths worldwide mainly in older people. Older people have poor vision and published evidence suggests that it is a risk factor for falls. Less than half of falls clinics assess vision as part of the multi-factorial assessment of older adults at risk of falls despite vision being an essential input for postural stability. The aim of our study was to investigate the relationship between all clinically assessed visual functions and falls amongst older adults in a prospective observational individually age-matched case control study. METHODS: Visual acuity (VA), contrast sensitivity (CS), depth perception, binocular vision and binocular visual field were measured using routinely used clinical methods in falls participants (N = 83) and non-falls participants (N = 83). Data were also collected on socio-demographic factors, general health, number of medications, health quality, fear of falling and physical activity. Logistic regression analysis was carried out to determine key visual and non-visual risk factors for falls whilst adjusting for confounding covariates. RESULTS: Older adults have an increased risk of experiencing a fall if they have reduced visual function (odds ratio (OR): 3.49, 1.64-7.45, p = 0.001), specifically impaired stereoacuity worse than 85" of arc (OR: 3.4, 1.20-9.69, p = 0.02) and reduced (by 0.15 log unit) high spatial frequency CS (18 cpd) (OR:1.40, 1.12-1.80, p = 0.003). Older adults with a hearing impairment are also at higher risk of falls (OR: 3.18, 95% CI: 1.36-7.40, p = 0.007). The risk decreases with living in a less deprived area (OR: 0.74, 0.64-0.86, <0.001), or socialising more out of the home (OR: 0.75, 0.60-0.93, p = 0.01). CONCLUSIONS: The combination of social, behavioural and biological determinants are significant predictors of a fall. The non-visual risk factors include older adults, living in deprived neighbourhoods, socialising less outside of the home and those who have a hearing impairment. Impaired functional visual measures; depth perception and contrast are significant visual risk factors for falls above visual acuity.

Manipulating expectancies in optometry practice: Ocular accommodation and stereoacuity are sensitive to placebo and nocebo effects.

INTRODUCTION: There is scientific evidence that an individual's beliefs and/or expectations play a role in the behavioural and physiological response to a given treatment. This study aimed to assess whether the dynamics of the accommodative response and stereoacuity are sensitive to experimentally induced placebo and nocebo effects. METHODS: Nineteen healthy university students performed three experimental sessions (placebo, nocebo and control) in randomised order, with the dynamics of the accommodative response (magnitude and variability), stereoacuity and subjective measures being assessed in all sessions. For the experimental manipulation, participants ingested an inert capsule that was alleged to have positive (white capsule, placebo condition) or negative (yellow capsule, nocebo conditions) effects on the human physiology. In the control condition, participants did not ingest a capsule. RESULTS: The data revealed that the variability of accommodation was sensitive to experimentally induced placebo and nocebo effects, showing a more stable accommodative response for the placebo compared with the nocebo condition (corrected p-value = 0.04, Cohen's d = 0.60). In addition, better stereoacuity was found with the placebo, compared with the nocebo (corrected p-value = 0.01, Cohen's d = 0.69) and control (corrected p-value = 0.03, Cohen's d = 0.59) conditions. Successful experimental manipulation was confirmed by the analysis of subjective perceptions. CONCLUSIONS: These findings provide evidence that manipulating expectations about the efficacy of an inert treatment affect the dynamics of the accommodative response (variability of accommodation) and stereoacuity. The results have important applications in both clinical and research outcomes, where individuals´ beliefs/expectations could modulate the visual function.

Validation of the novel Deep Reality Viewer (DRV) 3D digital stereo viewer in otology surgery.

PURPOSE: Magnification with accurate optic reproduction of the surgical field is essential in otology surgery, but current technologies are subject to specific disadvantages. This study aims to evaluate a novel 3D digital stereo viewer, the Deep Reality Viewer (DRV), in otology surgery, in comparison to both a 2D monitor and the gold standard of microscopy. METHODS: In this prospective clinical research study, ENT consultants and trainees evaluated visual and practical applications of the DRV. In visual assessment, participants (n = 11) viewed pre-recorded in vivo mastoid exploration displayed on a 2D monitor and the DRV screen. In practical assessment, participants (n = 9) performed otology surgical tasks on a cadaveric human head using both the microscope and DRV. Face, task-specific (TSV) and global content (GCV) outcomes were assessed using 5-point Likert scale questionnaires. Construct validity was assessed separately. RESULTS: The DRV achieved the pre-determined validation threshold of 4 for all validation parameters in both visual and practical assessment. The DRV significantly outperformed the 2D monitor in fourteen of 16 parameters. In comparison to microscopy, there was no significant difference in 13 of 16 parameters, with the DRV significantly outperforming in the remaining 3: defining anatomy (GCV), assessing middle ear anatomy (TSV) and overall TSV. Construct validity was not demonstrated for either technology. CONCLUSION: The DRV achieved the validation threshold for all parameters, and outperformed the 2D monitor and microscopy in several parameters. This validates the DRV for performing otological procedures, and suggests that it would be a useful alternative to the gold standard of microscopy in otology surgery. LEVEL OF EVIDENCE: N/A.

Quantitative influence and performance analysis of virtual reality laparoscopic surgical training system.

BACKGROUND: Virtual reality (VR) surgery training has become a trend in clinical education. Many research papers validate the effectiveness of VR-based surgical simulators in training medical students. However, most existing articles employ subjective methods to study the residents' surgical skills improvement. Few of them investigate how to improve the surgery skills on specific dimensions substantially. METHODS: Our paper resorts to physiological approaches to objectively study the quantitative influence and performance analysis of VR laparoscopic surgical training system for medical students. Fifty-one participants were recruited from a pool of medical students. They conducted four pre and post experiments in the training box. They were trained on VR-based laparoscopic surgery simulators (VRLS) in the middle of pre and post experiments. Their operation and physiological data (heart rate and electroencephalogram) are recorded during the pre and post experiments. The physiological data is used to compute cognitive load and flow experience quantitatively. Senior surgeons graded their performance using newly designed hybrid standards for fundamental tasks and Global operative assessment of laparoscopic skills (GOALS) standards for colon resection tasks. Finally, the participants were required to fill the questionnaires about their cognitive load and flow experience. RESULTS: After training on VRLS, the time of the experimental group to complete the same task could drop sharply (p < 0.01). The performance scores are enhanced significantly (p < 0.01). The performance and cognitive load computed from EEG are negatively correlated (p < 0.05). CONCLUSION: The results show that the VRLS could highly improve medical students' performance and enable the participants to obtain flow experience with a lower cognitive load. Participants' performance is negatively correlated with cognitive load through quantitative physiological analysis. This might provide a new way of assessing skill acquirement.

Disparity in Context: Understanding how monocular image content interacts with disparity processing in human visual cortex.

Horizontal disparities between the two eyes' retinal images are the primary cue for depth. Commonly used random ot tereograms (RDS) intentionally camouflage the disparity cue, breaking the correlations between monocular image structure and the depth map that are present in natural images. Because of the nonlinear nature of visual processing, it is unlikely that simple computational rules derived from RDS will be sufficient to explain binocular vision in natural environments. In order to understand the interplay between natural scene structure and disparity encoding, we used a depth-image-based-rendering technique and a library of natural 3D stereo pairs to synthesize two novel stereogram types in which monocular scene content was manipulated independent of scene depth information. The half-images of the novel stereograms comprised either random-dots or scrambled natural scenes, each with the same depth maps as the corresponding natural scene stereograms. Using these stereograms in a simultaneous Event-Related Potential and behavioral discrimination task, we identified multiple disparity-contingent encoding stages between 100 ~ 500 msec. The first disparity sensitive evoked potential was observed at ~100 msec after an earlier evoked potential (between ~50-100 msec) that was sensitive to the structure of the monocular half-images but blind to disparity. Starting at ~150 msec, disparity responses were stereogram-specific and predictive of perceptual depth. Complex features associated with natural scene content are thus at least partially coded prior to disparity information, but these features and possibly others associated with natural scene content interact with disparity information only after an intermediate, 2D scene-independent disparity processing stage.

Taking aim at the perceptual side of motor learning: exploring how explicit and implicit learning encode perceptual error information through depth vision.

Motor learning in visuomotor adaptation tasks results from both explicit and implicit processes, each responding differently to an error signal. Although the motor output side of these processes has been extensively studied, the visual input side is relatively unknown. We investigated if and how depth perception affects the computation of error information by explicit and implicit motor learning. Two groups of participants made reaching movements to bring a virtual cursor to a target in the frontoparallel plane. The Delayed group was allowed to reaim and their feedback was delayed to emphasize explicit learning, whereas the camped group received task-irrelevant clamped cursor feedback and continued to aim straight at the target to emphasize implicit adaptation. Both groups played this game in a highly detailed virtual environment (depth condition), leveraging a cover task of playing darts in a virtual tavern, and in an empty environment (no-depth condition). The delayed group showed an increase in error sensitivity under depth relative to no-depth. In contrast, the clamped group adapted to the same degree under both conditions. The movement kinematics of the delayed participants also changed under the depth condition, consistent with the target appearing more distant, unlike the Clamped group. A comparison of the delayed behavioral data with a perceptual task from the same individuals showed that the greater reaiming in the depth condition was consistent with an increase in the scaling of the error distance and size. These findings suggest that explicit and implicit learning processes may rely on different sources of perceptual information.NEW & NOTEWORTHY We leveraged a classic sensorimotor adaptation task to perform a first systematic assessment of the role of perceptual cues in the estimation of an error signal in the 3-D space during motor learning. We crossed two conditions presenting different amounts of depth information, with two manipulations emphasizing explicit and implicit learning processes. Explicit learning responded to the visual conditions, consistent with perceptual reports, whereas implicit learning appeared to be independent of them.

Towards describing scenes by animals: Pigeons' ordinal discrimination of objects varying in depth.

The perception of a complex scene requires visual mechanisms that include identifying objects and their relative placement in depth. To examine apparent depth perception in birds, we tested four pigeons with a novel multiple-sequential-choice procedure. We created 3D-rendered scene stimuli containing three objects located at different apparent depths based on a variety of pictorial cues and placed small circular target response areas on them. The pigeons were trained to sequentially choose among the multiple response areas to report the object closest in apparent depth (ordinal position; front then middle object). After the pigeons learned this sequential depth discrimination, their use of three different monocular depth cues (occlusion, relative size, height in field) was tested, and their flexibility evaluated using three novel objects. In addition to the contribution to understanding apparent depth perception in birds, the use of more flexible open-ended choice discriminations, as employed here, has considerable promise for creating informative production-like tasks in nonverbal animals.

Use of Botulinum Toxin in Ophthalmology.

Botulinum toxin is an important treatment for many conditions in ophthalmology, including strabismus, nystagmus, blepharospasm, hemifacial spasm, spastic and congenital entropion, corneal exposure, and persistent epithelial defects. The mechanism of action of botulinum toxin for both strabismus and nystagmus is the neuromuscular blockade and transient paralysis of extraocular muscles, but when botulinum toxin is used for some forms of strabismus, a single injection can convey indefinite benefits. There are two unique mechanisms of action that account for the long-term effect on ocular alignment: (1) the disruption of a balanced system of agonist-antagonist extraocular muscles and (2) the reestablishment of central control of alignment by the binocular visual system. For other ocular conditions, botulinum toxin acts through transient paralysis of periocular muscles. Botulinum toxin is a powerful tool in ophthalmology, achieving its therapeutic effects by direct neuromuscular blockade of extraocular and periocular muscles and by unique mechanisms related to the underlying structure and function of the visual system.

Psychophysical evidence for auditory motion parallax.

Distance is important: From an ecological perspective, knowledge about the distance to either prey or predator is vital. However, the distance of an unknown sound source is particularly difficult to assess, especially in anechoic environments. In vision, changes in perspective resulting from observer motion produce a reliable, consistent, and unambiguous impression of depth known as motion parallax. Here we demonstrate with formal psychophysics that humans can exploit auditory motion parallax, i.e., the change in the dynamic binaural cues elicited by self-motion, to assess the relative depths of two sound sources. Our data show that sensitivity to relative depth is best when subjects move actively; performance deteriorates when subjects are moved by a motion platform or when the sound sources themselves move. This is true even though the dynamic binaural cues elicited by these three types of motion are identical. Our data demonstrate a perceptual strategy to segregate intermittent sound sources in depth and highlight the tight interaction between self-motion and binaural processing that allows assessment of the spatial layout of complex acoustic scenes.