Review: Binocular double vision in the presence of visual field loss.

Binocular double vision in strabismus is marked by diplopia (seeing the same object in two different directions) and visual confusion (seeing two different objects in the same direction). In strabismus with full visual field, the diplopia coexists with visual confusion across most of the binocular field. With visual field loss, or with use of partial prism segments for field expansion, the two phenomena may be separable. This separability is the focus of this review and offers new insights into binocular function. We show that confusion is necessary but is not sufficient for field expansion. Diplopia plays no role in field expansion but is necessary for clinical testing of strabismus, making such testing difficult in field loss conditions with confusion without diplopia. The roles of the three-dimensional structure of the real world and the dynamic of eye movements within that structure are considered as well. Suppression of one eye's partial view under binocular vision that develops in early-onset (childhood) strabismus is assumed to be a sensory adaption to diplopia. This assumption can be tested using the separation of diplopia and confusion.

The Invisibility of Scotomas I: The Carving Hypothesis.

SIGNIFICANCE: Veridical depictions of scene appearance with scotomas allow better understanding of the impact of field loss and may improve the development and implementation of rehabilitation. Explanation and depiction of the invisibility of scotoma may lead to patients' understanding and thus better compliance with related treatments. PURPOSE: Simulations of perception with scotomas guide training, patient education, and rehabilitation research. Most simulations incorrectly depict scotomas as black patches, although the scotomas and the missing contents are usually invisible to patients. We present a novel approach to capture the reported appearance of scenes with scotomas. METHODS: We applied a content-aware image resizing algorithm to carve out the content elided under the scotomas. With video sequences, we show how and why eye movements fail to increase the visibility of the carved scotomas. RESULTS: Numerous effects, reported by patients, emerge naturally from the scotoma carving. Carving-eliminated scotomas over natural images are barely visible, despite causing substantial distortions. Low resolution and contrast sensitivity at farther eccentricities and saccadic blur reduce the visibility of the distortions. In a walking scenario, static objects moving smoothly to the periphery disappear into and then reemerge out of peripheral scotomas, invisibly. CONCLUSIONS: Scotoma carving provides a viable hypothetical simulation of vision with scotomas due to loss of neurons at the retinal ganglion cell level and higher. As a hypothesis, it generates predictions that lend themselves to future clinical testing. The different effects of scotomas due to loss of photoreceptors are left for follow-up work.

Comparison of visual SLAM and IMU in tracking head movement outdoors.

Tracking head movement in outdoor activities is more challenging than in controlled indoor lab environments. Large-magnitude head scanning is common under natural conditions. Compensatory gaze (head and eye) scanning while walking may be critical for people with visual field loss. We compared the accuracy of two outdoor head tracking methods: differential inertial measurement units (IMU) and simultaneous localization and mapping (SLAM). At a fixed location experiment, a gaze aiming test showed that SLAM outperforms IMU in terms of error (IMU: 9.6°, SLAM: 4.47°). In an urban street walking experiment conducted with five patients with hemifield loss, the IMU drift, quantified by root-mean-square deviation, was as high as 68.1°, while the drift of SLAM was only 5.3°. However, the SLAM method suffered from data loss due to tracking failure (~10% overall, and ~ 18% when crossing streets). Our results show that the SLAM and IMU methods have complementary properties. Because of no data gaps, the differential IMU method may be desirable as compared to SLAM in settings where the signal drift can be removed in post-processing and small gaze estimation errors can be tolerated.

Effects of Perceptual-motor Training on Collision Judgments with Peripheral Prism Expanded Vision.

SIGNIFICANCE: Peripheral prisms (p-prisms) improve blind-side detection of hazards in hemianopia by shifting the image of the hazard into the intact visual field. Collision judgments can be made accurately after detection by using a gaze shift to fixate the hazard in the prism-free portion of the lens, but this is slow relative to normal peripheral vision. A prior study found that prism adaptation for visual direction did not occur with general wear. We developed a perceptual-motor training regimen that resulted in accurate pointing at p-prism targets after six 1-hour sessions. PURPOSE: This study aimed to determine if improvements in pointing accuracy from perceptual-motor training generalized to collision judgments during simulated walking. METHODS: Participants with hemianopia (n = 13) made collision judgments in virtual reality for a person appearing 0.4 to 13.5° from the walking path. Judgments were measured under fixed gaze, requiring collision judgments via the p-prism image only, and free gaze, representing a more natural scenario. Measurements were made without and with p-prisms immediately after fitting, after a 2-week acclimation, after training, and 3 months later. Controls (n = 13) did one visit without p-prisms. RESULTS: Controls had 100% detection and symmetrically distributed collision judgments for the central 33 and 36% of hazards under fixed gaze and free gaze, respectively. In hemianopia, the seeing side was not different from controls. Blind-side detection was reduced without p-prisms to 40% fixed gaze and 82% free gaze and improved with p-prisms to 99% fixed gaze and 97% free gaze (P < .001). When first worn, fixed-gaze prism side collisions were 63 versus 37% on the seeing side and 41 versus 39% for free gaze (P < .001). There was a small improvement for fixed gaze after the 2-week acclimation (53%, P < .001), but no improvements from training or an additional 3 months of use. CONCLUSIONS: P-prisms improved detection, but collision judgments were inaccurate when seen only via the p-prisms and did not improve with perceptual-motor training. Patients should continue to be advised to turn their head and eyes to fixate the hazard after detection.

Photographic Depiction of the Field of View with Spectacles-mounted Low Vision Aids.

SIGNIFICANCE: Photographic depiction helps to illustrate the primary and secondary field of view effects of low vision devices along with their utility to clinicians, patients, and caretakers. This technique may also be helpful for designers and researchers in improving the design and fitting of low vision devices. PURPOSE: The field of view through spectacles-mounted low vision devices has typically been evaluated using perimetry. However, the perimetric field diagram is different from the retinal image and often fails to represent the important aspects of the field of view and visual parameters. We developed a photographic depiction method to record and veridically show the field of view effects of these devices. METHODS: We used a 3D-printed holder to place spectacles-mounted devices at the same distance from the empirically determined reference point of the field of view in a camera lens (f = 16 mm) as they would be from an eye, when in use. The field of view effects of a bioptic telescope, a minifier (reverse telescope), and peripheral prisms were captured using a conventional camera, representing retinal images. The human eye pupil size (adjusting the F number: f/2.8 to f/8 and f/22 in the camera lens) and fitting parameters (pantoscopic tilt and back vertex distance) varied. RESULTS: Real-world indoor and outdoor walking and driving scenarios were depicted as retinal images illustrating the field of view through low vision devices, distinguishing optical and obscuration scotomas, and demonstrating secondary effects (spatial distortions, viewpoint changes, diplopia, spurious reflection, and multiplexing effects) not illustrated by perimetric field diagrams. CONCLUSIONS: Photographic depiction illustrates the primary and secondary field of view effects of the low vision devices. These images highlight the benefit and possible trade-offs of the low vision devices and may be beneficial in education and training.

2017 Charles F. Prentice Award Lecture: Peripheral Prisms for Visual Field Expansion: A Translational Journey.

On the occasion of being awarded the Prentice Medal, I was asked to summarize my translational journey. Here I describe the process of becoming a low-vision rehabilitation clinician and researcher, frustrated by the unavailability of effective treatments for some conditions. This led to decades of working to understand patients' needs and the complexities and subtleties of their visual systems and conditions. It was followed by many iterations of developing vision aids and the techniques needed to objectively evaluate their benefit. I specifically address one path: the invention and development of peripheral prisms to expand the visual fields of patients with homonymous hemianopia, leading to our latest multiperiscopic prism (mirror-based design) with its clear 45° field-of-view image shift.

Pedestrians Accept Shorter Distances to Light Vehicles Than Dark Ones When Crossing the Street.

Does the brightness of an approaching vehicle affect a pedestrian's crossing decision? Thirty participants indicated their street-crossing intentions when facing approaching light or dark vehicles. The experiment was conducted in a real daylight environment and, additionally, in a corresponding virtual one. A real road with actual cars provides high face validity, while a virtual environment ensures the scenario's precise reproducibility and repeatability for each participant. In both settings, participants judged dark vehicles to be a more imminent threat-either closer or moving faster-when compared with light ones. Secondary results showed that participants accepted a significantly shorter time-to-contact when crossing the street in the virtual setting than on the real road.

Design of 45° periscopic visual field expansion device for peripheral field loss.

Patients with visual field loss have difficulty in mobility due to collision with pedestrians/obstacles from the blind side. In order to retrieve the lost visual field, prisms which deflect the field from the blind to the seeing side, have been widely used. However, the deflection power of current clinical Fresnel prisms is limited to ~30° and only provides a 5° eye scanning range to the blind side. This is not sufficient to avoid collision and results in increasing demands for a device with a higher power. In this paper, we propose a novel design and optimization of a higher power prism-like device (cascaded structure of mirror pairs filled with high refractive index) and verify enhanced expansion of up to 45° in optical ray tracing and photorealistic simulations.

A Pilot Study on EEG-Based Evaluation of Visually Induced Motion Sickness.

The most prominent problem in virtual reality (VR) technology is that users may experience motion sickness-like symptoms when they immerse into a VR environment. These symptoms are recognized as visually induced motion sickness (VIMS) or virtual reality motion sickness (VRMS). The objectives of this study were to investigate the association between the electroencephalogram (EEG) and subjectively rated VIMS level (VIMSL) and find the EEG markers for VIMS evaluation. In this study, a VR-based vehicle-driving simulator (VDS) was used to induce VIMS symptoms, and a wearable EEG device with four electrodes, the Muse, was used to collect EEG data of subjects. Our results suggest that individual tolerance, susceptibility, and recoverability to VIMS varied largely among subjects; the following markers were shown to be significantly different from no-VIMS and VIMS states (P < 0.05): (1) Means of gravity frequency (GF) for theta@FP1, alpha@TP9, alpha@FP2, alpha@TP10, and beta@FP1; (2) Standard deviation of GF for alpha@TP9, alpha@FP1, alpha@FP2, alpha@TP10, and alpha@(FP2-FP1); (3) Standard deviation of power spectral entropy (PSE) for FP1; (4) Means of Kolmogorov complexity (KC) for TP9, FP1, and FP2. These results also demonstrate that it is feasible to perform VIMS evaluation using an EEG device with a small number of electrodes.

Stereoscopic 3D Optic Flow Distortions Caused by Mismatches between Image Acquisition and Display Parameters.

We analyze the impact of common stereoscopic 3D (S3D) depth distortion on S3D optic flow in virtual reality (VR) environments. The depth distortion is introduced by mismatches between the image acquisition and display parameter. The results show that such S3D distortions induce large S3D optic flow distortions and may even induce partial/full optic flow reversal within a certain depth range, depending on the viewer's moving speed and the magnitude of S3D distortion introduced. We hypothesize that the S3D optic flow distortion may be a source of intra-sensory conflict that may be a source of visually induced motion sickness (VIMS) in S3D.

No Useful Field Expansion with Full-field Prisms.

SIGNIFICANCE: Full-field prisms that fill the entire spectacle eye wire have been considered as field expansion devices for homonymous hemianopia (HH) and acquired monocular vision (AMV). Although the full-field prism is used for addressing binocular dysfunction and for prism adaptation training after brain injury as treatment for spatial hemineglect, we show that the full-field prism for field expansion does not effectively expand the visual field in either HH or AMV. PURPOSE: Full-field prisms may shift a portion of the blind side to the residual seeing side. However, foveal fixation on an object of interest through a full-field prism requires head and/or eye rotation away from the blind side, thus negating the shift of the field toward the blind side. METHODS: We fit meniscus and flat full-field 7Δ and 12Δ yoked prisms and conducted Goldmann perimetry in HH and AMV. We compared the perimetry results with ray tracing calculations. RESULTS: The rated prism power was in effect at the primary position of gaze for all prisms, and the meniscus prisms maintained almost constant power at all eccentricities. To fixate on the perimetry target, the subjects needed to turn their head and/or eyes away from the blind side, which negated the field shift into the blind side. In HH, there was no difference in the perimetry results on the blind side with any of the prisms. In AMV, the lower nasal field of view was slightly shifted into the blind side with the flat prisms, but not with the meniscus prisms. CONCLUSIONS: Full-field prisms are not an effective field expansion device owing to the inevitable fixation shift. There is potential for a small field shift with the flat full-field prism in AMV, but such lenses cannot incorporate refractive correction. Furthermore, in considering the apical scotoma, the shift provides a mere field substitution at best.

Field Expansion for Acquired Monocular Vision Using a Multiplexing Prism.

SIGNIFICANCE: Acquired monocular vision (AMV) is a common visual field loss. Patients report mobility difficulties in walking due to collisions with objects or other pedestrians on the blind side. PURPOSE: The visual field of people with AMV extends more than 90° temporally on the side of the seeing eye but is restricted to approximately 55° nasally. We developed a novel field expansion device using a multiplexing prism (MxP) that superimposes the see-through and shifted views for true field expansion without apical scotoma. We present various designs of the device that enable customized fitting and improved cosmetics. METHODS: A partial MxP segment is attached (base-in) near the nose bridge. To avoid total internal reflection due to the high angle of incidence at nasal field end (55°), we fit the MxP with serrations facing the eye and tilt the prism base toward the nose. We calculated the width of the MxP (the apex location) needed to prevent apical scotoma and monocular diplopia. We also consider the effect of spectacle prescriptions on these settings. The results are verified perimetrically. RESULTS: We documented the effectivity of various prototype glasses designs with perimetric measurements. With the prototypes, all patients with AMV had field-of-view expansions up to 90° nasally without any loss of seeing field. CONCLUSIONS: The novel and properly mounted MxP in glasses has the potential for meaningful field-of-view expansion up to the size of normal binocular vision in cosmetically acceptable form.

Peripheral Prisms Improve Obstacle Detection during Simulated Walking for Patients with Left Hemispatial Neglect and Hemianopia.

SIGNIFICANCE: The first report on the use of peripheral prisms (p-prisms) for patients with left neglect and homonymous visual field defects (HVFDs). PURPOSE: The purpose of this study was to investigate if patients with left hemispatial neglect and HVFDs benefit from p-prisms to expand the visual field and improve obstacle detection. METHODS: Patients (24 with HVFDs, 10 of whom had left neglect) viewed an animated, virtual, shopping mall corridor and reported if they would have collided with a human obstacle that appeared at various offsets up to 13.5° from their simulated walking path. There were 40 obstacle presentations on each side, with and without p-prisms. No training with p-prisms was provided, and gaze was fixed at the center of expansion. RESULTS: Detection on the side of the HVFD improved significantly with p-prisms in both groups, from 26 to 92% in the left-neglect group and 43 to 98% in the non-neglect group (both P < .001). There was a tendency for greater improvement in the neglect patients with p-prisms. For collision judgments, both groups exhibited a large increase in perceived collisions on the side of the HVFD with the prisms (P < .001), with no difference between the groups (P = .93). Increased perceived collisions represent a wider perceived safety margin on the side of the HVFD. CONCLUSIONS: Within the controlled conditions of this simulated, collision judgment task, patients with left neglect responded well to initial application of p-prisms exhibiting improved detection and wider safety margins on the side of the HVFD that did not differ from non-neglect patients. Further study of p-prisms for neglect patients in free-gaze conditions after extended wear and in real-world mobility tasks is clearly warranted.

Evaluation of a Paradigm to Investigate Detection of Road Hazards when Using a Bioptic Telescope.

SIGNIFICANCE: A new driving simulator paradigm was developed and evaluated that will enable future investigations of the effects of the ring scotoma in bioptic drivers with diverse vision impairments and different telescope designs. PURPOSE: The ring scotoma may impair detection of peripheral hazards when viewing through a bioptic telescope. To investigate this question, we developed and tested a sign-reading and pedestrian-detection paradigm in a driving simulator. METHODS: Twelve normally sighted subjects with simulated acuity loss (median 20/120) used a 3.0× monocular bioptic to read 36 road signs while driving in a simulator. Thirteen of 21 pedestrian hazards appeared and ran on the road for 1 second within the ring scotoma while participants were reading signs through the bioptic. Head movements were analyzed to determine whether the pedestrian appeared before or only while using the bioptic. Six subjects viewed binocularly, and six viewed monocularly (fellow eye patched). Two patients with real visual acuity loss in one eye and no light perception in the other performed the same tasks using their own telescopes. RESULTS: For the monocular simulated acuity loss group, detection rates were significantly higher when the pedestrian appeared before using the bioptic than when it appeared while using the bioptic and was likely within the area of the ring scotoma (77% vs. 28%, P < .001). For the binocular simulated acuity loss group, there was no significant difference in detection rates for pedestrians that appeared before or while using the bioptic (80% vs. 91%, P = .20). The two monocular patients detected only 17% of pedestrians that appeared while looking through the bioptic. CONCLUSIONS: Our results confirm the utility of the testing paradigm and suggest that the fellow eye of normally sighted observers with simulated acuity loss was able to compensate for the ring scotoma when using a monocular bioptic telescope in a realistic driving task.

Multiplexing Prisms for Field Expansion.

PURPOSE: Prisms used for field expansion are limited by the optical scotoma at a prism apex (apical scotoma). For a patient with two functioning eyes, fitting prisms unilaterally allows the other eye to compensate for the apical scotoma. A monocular patient's field loss cannot be expanded with a conventional or Fresnel prism because of the apical scotoma. A newly invented optical device, the multiplexing prism (MxP), was developed to overcome the apical scotoma limitation in monocular field expansion. METHODS: A Fresnel-prism-like device with alternating prism and flat elements superimposes shifted and see-through views, thus creating the (monocular) visual confusion required for field expansion and eliminating the apical scotoma. Several implementations are demonstrated and preliminarily evaluated for different monocular conditions with visual field loss. The field expansion of the MxP is compared with the effect of conventional prisms using calculated and measured perimetry. RESULTS: Field expansion without apical scotomas is shown to be effective for monocular patients with hemianopia or constricted peripheral field. The MxPs are shown to increase the nasal field for a patient with only one eye and for patients with bitemporal hemianopia. The MxPs placed at the far temporal field are shown to expand the normal visual field. The ability to control the contrast ratio between the two images is verified. CONCLUSIONS: A novel optical device is demonstrated to have the potential for field expansion technology in a variety of conditions. The devices may be inexpensive and can be constructed in a cosmetically acceptable format.

High-Power Prismatic Devices for Oblique Peripheral Prisms.

PURPOSE: Horizontal peripheral prisms for hemianopia provide field expansion above and below the horizontal meridian; however, there is a vertical gap leaving the central area (important for driving) without expansion. In the oblique design, tilting the bases of both prism segments toward the horizontal meridian moves the field expansion area vertically and centrally (closing the central gap) while the prisms remain in the peripheral location. However, tilting the prisms results also in a reduction of the lateral field expansion. Higher prism powers are needed to counter this effect. METHODS: We developed, implemented, and tested a series of designs aimed at increasing the prism power to reduce the central gap while maintaining wide lateral expansion. The designs included inserting the peripheral prisms into carrier lenses that included yoked prism in the opposite direction, combination of two Fresnel segments attached at the base and angled to each other (bi-part prisms), and creating Fresnel prism-like segments from nonparallel periscopic mirror pairs (reflective prisms). RESULTS: A modest increase in lateral power was achieved with yoked-prism carriers. Bi-part combination of 36Δ Fresnel segments provided high power with some reduction in image quality. Fresnel reflective prism segments have potential for high power with superior optical quality but may be limited in field extent or by interruptions of the expanded field. Extended apical scotomas, even with unilateral fitting, may limit the utility of very high power prisms. The high-power bi-part and reflective prisms enable a wider effective eye scanning range (more than 15 degrees) into the blind hemifield. CONCLUSIONS: Conventional prisms of powers higher than the available 57Δ are limited by the binocular impact of a wider apical scotoma and a reduced effective eye scanning range to the blind side. The various designs that we developed may overcome these limitations and find use in various other field expansion applications.

The risk of pedestrian collisions with peripheral visual field loss.

Patients with peripheral field loss complain of colliding with other pedestrians in open-space environments such as shopping malls. Field expansion devices (e.g., prisms) can create artificial peripheral islands of vision. We investigated the visual angle at which these islands can be most effective for avoiding pedestrian collisions, by modeling the collision risk density as a function of bearing angle of pedestrians relative to the patient. Pedestrians at all possible locations were assumed to be moving in all directions with equal probability within a reasonable range of walking speeds. The risk density was found to be highly anisotropic. It peaked at ≈45° eccentricity. Increasing pedestrian speed range shifted the risk to higher eccentricities. The risk density is independent of time to collision. The model results were compared to the binocular residual peripheral island locations of 42 patients with forms of retinitis pigmentosa. The natural residual island prevalence also peaked nasally at about 45° but temporally at about 75°. This asymmetry resulted in a complementary coverage of the binocular field of view. Natural residual binocular island eccentricities seem well matched to the collision-risk density function, optimizing detection of other walking pedestrians (nasally) and of faster hazards (temporally). Field expansion prism devices will be most effective if they can create artificial peripheral islands at about 45° eccentricities. The collision risk and residual island findings raise interesting questions about normal visual development.

Mobile gaze tracking system for outdoor walking behavioral studies.

Most gaze tracking techniques estimate gaze points on screens, on scene images, or in confined spaces. Tracking of gaze in open-world coordinates, especially in walking situations, has rarely been addressed. We use a head-mounted eye tracker combined with two inertial measurement units (IMU) to track gaze orientation relative to the heading direction in outdoor walking. Head movements relative to the body are measured by the difference in output between the IMUs on the head and body trunk. The use of the IMU pair reduces the impact of environmental interference on each sensor. The system was tested in busy urban areas and allowed drift compensation for long (up to 18 min) gaze recording. Comparison with ground truth revealed an average error of 3.3° while walking straight segments. The range of gaze scanning in walking is frequently larger than the estimation error by about one order of magnitude. Our proposed method was also tested with real cases of natural walking and it was found to be suitable for the evaluation of gaze behaviors in outdoor environments.

Comparing object recognition from binary and bipolar edge images for visual prostheses.

Visual prostheses require an effective representation method due to the limited display condition which has only 2 or 3 levels of grayscale in low resolution. Edges derived from abrupt luminance changes in images carry essential information for object recognition. Typical binary (black and white) edge images have been used to represent features to convey essential information. However, in scenes with a complex cluttered background, the recognition rate of the binary edge images by human observers is limited and additional information is required. The polarity of edges and cusps (black or white features on a gray background) carries important additional information; the polarity may provide shape from shading information missing in the binary edge image. This depth information may be restored by using bipolar edges. We compared object recognition rates from 16 binary edge images and bipolar edge images by 26 subjects to determine the possible impact of bipolar filtering in visual prostheses with 3 or more levels of grayscale. Recognition rates were higher with bipolar edge images and the improvement was significant in scenes with complex backgrounds. The results also suggest that erroneous shape from shading interpretation of bipolar edges resulting from pigment rather than boundaries of shape may confound the recognition.

Peripheral prism glasses: effects of moving and stationary backgrounds.

PURPOSE: Unilateral peripheral prisms for homonymous hemianopia (HH) expand the visual field through peripheral binocular visual confusion, a stimulus for binocular rivalry that could lead to reduced predominance and partial suppression of the prism image, thereby limiting device functionality. Using natural-scene images and motion videos, we evaluated whether detection was reduced in binocular compared with monocular viewing. METHODS: Detection rates of nine participants with HH or quadranopia and normal binocularity wearing peripheral prisms were determined for static checkerboard perimetry targets briefly presented in the prism expansion area and the seeing hemifield. Perimetry was conducted under monocular and binocular viewing with targets presented over videos of real-world driving scenes and still frame images derived from those videos. RESULTS: With unilateral prisms, detection rates in the prism expansion area were significantly lower in binocular than in monocular (prism eye) viewing on the motion background (medians, 13 and 58%, respectively, p = 0.008) but not the still frame background (medians, 63 and 68%, p = 0.123). When the stimulus for binocular rivalry was reduced by fitting prisms bilaterally in one HH and one normally sighted subject with simulated HH, prism-area detection rates on the motion background were not significantly different (p > 0.6) in binocular and monocular viewing. CONCLUSIONS: Conflicting binocular motion appears to be a stimulus for reduced predominance of the prism image in binocular viewing when using unilateral peripheral prisms. However, the effect was only found for relatively small targets. Further testing is needed to determine the extent to which this phenomenon might affect the functionality of unilateral peripheral prisms in more real-world situations.