Visual navigation: properties, acquisition and use of views.

Panoramic views offer information on heading direction and on location to visually navigating animals. This review covers the properties of panoramic views and the information they provide to navigating animals, irrespective of image representation. Heading direction can be retrieved by alignment matching between memorized and currently experienced views, and a gradient descent in image differences can lead back to the location at which a view was memorized (positional image matching). Central place foraging insects, such as ants, bees and wasps, conduct distinctly choreographed learning walks and learning flights upon first leaving their nest that are likely to be designed to systematically collect scene memories tagged with information provided by path integration on the direction of and the distance to the nest. Equally, traveling along routes, ants have been shown to engage in scanning movements, in particular when routes are unfamiliar, again suggesting a systematic process of acquiring and comparing views. The review discusses what we know and do not know about how view memories are represented in the brain of insects, how they are acquired and how they are subsequently used for traveling along routes and for pinpointing places.

Views from 'crabworld': the spatial distribution of light in a tropical mudflat.

Natural scene analysis has been extensively used to understand how the invariant structure of the visual environment may have shaped biological image processing strategies. This paper deals with four crucial, but hitherto largely neglected aspects of natural scenes: (1) the viewpoint of specific animals; (2) the fact that image statistics are not independent of the position within the visual field; (3) the influence of the direction of illumination on luminance, spectral and polarization contrast in a scene; and (4) the biologically relevant information content of natural scenes. To address these issues, I recorded the spatial distribution of light in a tropical mudflat with a spectrographic imager equipped with a polarizing filter in an attempt to describe quantitatively the visual environment of fiddler crabs. The environment viewed by the crabs has a distinct structure. Depending on the position of the sun, the luminance, the spectral composition, and the polarization characteristics of horizontal light distribution are not uniform. This is true for both skylight and for reflections from the mudflat surface. The high-contrast feature of the line of horizon dominates the vertical distribution of light and is a discontinuity in terms of luminance, spectral distribution and of image statistics. On a clear day, skylight intensity increases towards the horizon due to multiple scattering, and its spectral composition increasingly resembles that of sunlight. Sky-substratum contrast is highest at short wavelengths. I discuss the consequences of this extreme example of the topography of vision for extracting biologically relevant information from natural scenes.

The role of attractive and repellent scene memories in ant homing (Myrmecia croslandi).

Solitary foraging ants rely on vision when travelling along routes and when pinpointing their nest. We tethered foragers of Myrmecia croslandi on a trackball and recorded their intended movements when the trackball was located on their normal foraging corridor (on-route), above their nest and at a location several metres away where they have never been before (off-route). We found that at on- and off-route locations, most ants walk in the nest or foraging direction and continue to do so for tens of metres in a straight line. In contrast, above the nest, ants walk in random directions and change walking direction frequently. In addition, the walking direction of ants above the nest oscillates on a fine scale, reflecting search movements that are absent from the paths of ants at the other locations. An agent-based simulation shows that the behaviour of ants at all three locations can be explained by the integration of attractive and repellent views directed towards or away from the nest, respectively. Ants are likely to acquire such views via systematic scanning movements during their learning walks. The model predicts that ants placed in a completely unfamiliar environment should behave as if at the nest, which our subsequent experiments confirmed. We conclude first, that the ants' behaviour at release sites is exclusively driven by what they currently see and not by information on expected outcomes of their behaviour; and second, that navigating ants might continuously integrate attractive and repellent visual memories. We discuss the benefits of such a procedure.

Cyclic nature of the REM sleep-like state in the cuttlefish Sepia officinalis.

Sleep is a state of immobility characterized by three key criteria: an increased threshold of arousal, rapid reversal to an alert state and evidence of homeostatic 'rebound sleep' in which there is an increase in the time spent in this quiescent state following sleep deprivation. Common European cuttlefish, Sepia officinalis, show states of quiescence during which they meet the last two of these three criteria, yet also show spontaneous bursts of arm and eye movements that accompany rapid changes in chromatophore patterns in the skin. Here, we report that this rapid eye movement sleep-like (REMS-like) state is cyclic in nature. Iterations of the REMS-like state last 2.42±0.22 min (mean±s.e.m.) and alternate with 34.01±1.49 min of the quiescent sleep-like state for durations lasting 176.89±36.71 min. We found clear evidence that this REMS-like state (i) occurs in animals younger than previously reported; (ii) follows an ultradian pattern; (iii) includes intermittent dynamic chromatophore patterning, representing fragments of normal patterning seen in the waking state for a wide range of signaling and camouflage; and (iv) shows variability in the intensity of expression of these skin patterns between and within individuals. These data suggest that cephalopods, which are mollusks with an elaborate brain and complex behavior, possess a sleep-like state that resembles behaviorally the vertebrate REM sleep state, although the exact nature and mechanism of this form of sleep may differ from that of vertebrates.

An insect-inspired model for acquiring views for homing.

Wasps and bees perform learning flights when leaving their nest or food locations for the first time during which they acquire visual information that enables them to return successfully. Here we present and test a set of simple control rules underlying the execution of learning flights that closely mimic those performed by ground-nesting wasps. In the simplest model, we assume that the angle between flight direction and the nest direction as seen from the position of the insect is constant and only flips sign when pivoting direction around the nest is changed, resulting in a concatenation of piecewise defined logarithmic spirals. We then added characteristic properties of real learning flights, such as head saccades and the condition that the nest entrance within the visual field is kept nearly constant to describe the development of a learning flight in a head-centered frame of reference, assuming that the retinal position of the nest is known. We finally implemented a closed-loop simulation of learning flights based on a small set of visual control rules. The visual input for this model are rendered views generated from 3D reconstructions of natural wasp nesting sites, and the retinal nest position is controlled by means of simple template-based tracking. We show that naturalistic paths can be generated without knowledge of the absolute distance to the nest or of the flight speed. We demonstrate in addition that nest-tagged views recorded during such simulated learning flights are sufficient for a homing agent to pinpoint the goal, by identifying nest direction when encountering familiar views. We discuss how the information acquired during learning flights close to the nest can be integrated with long-range homing models.

Diversity and common themes in the organization of ocelli in Hymenoptera, Odonata and Diptera.

We show in a comparative analysis that distinct retinal specializations in insect ocelli are much more common than previously realized and that the rhabdom organization of ocellar photoreceptors is extremely diverse. Hymenoptera, Odonata and Diptera show prominent equatorial fovea-like indentations of the ocellar retinae, where distal receptor endings are furthest removed from the lens surface and receptor densities are highest. In contrast, rhabdomere arrangements are very diverse across insect groups: in Hymenoptera, with some exceptions, pairs of ocellar retinular cells form sheet-like rhabdoms that form elongated rectangular shapes in cross-section, with highly aligned microvilli directions perpendicular to the long axis of cross-sections. This arrangement makes most ocellar retinular cells in Hymenoptera sensitive to the direction of polarized light. In dragonflies, triplets of retinular cells form a y-shaped fused rhabdom with microvilli directions oriented at 60° to each other. In Dipteran ocellar retinular cells microvilli directions are randomised, which destroys polarization sensitivity. We suggest that the differences in ocellar organization between insect groups may reflect the different head attitude control systems that have evolved in these insect groups, but possibly also differences in the mode of locomotion and in the need for celestial compass information.

The choreography of learning walks in the Australian jack jumper ant Myrmecia croslandi.

We provide a detailed analysis of the learning walks performed by Myrmecia croslandi ants at the nest during which they acquire visual information on its location. Most learning walks of 12 individually marked naïve ants took place in the morning with a narrow time window separating the first two learning walks, which most often occurred on the same day. Naïve ants performed between two and seven walks over up to four consecutive days before heading out to forage. On subsequent walks, naïve ants tend to explore the area around the nest in new compass directions. During learning walks, ants move along arcs around the nest while performing oscillating scanning movements. In a regular temporal sequence, the ants' gaze oscillates between the nest direction and the direction pointing away from the nest. Ants thus experience a sequence of views roughly across the nest and away from the nest from systematically spaced vantage points around the nest. Further, we show that ants leaving the nest for a foraging trip often walk in an arc around the nest on the opposite side to the intended foraging direction, performing a scanning routine indistinguishable from that of a learning walk. These partial learning walks are triggered by disturbance around the nest and may help returning ants with reorienting when overshooting the nest, which they frequently do. We discuss what is known about learning walks in different ant species and their adaptive significance for acquiring robust navigational memories.

Regional differences in the preferred e-vector orientation of honeybee ocellar photoreceptors.

In addition to compound eyes, honeybees (Apis mellifera) possess three single-lens eyes called ocelli located on the top of the head. Ocelli are involved in head-attitude control and in some insects have been shown to provide celestial compass information. Anatomical and early electrophysiological studies have suggested that UV and blue-green photoreceptors in ocelli are polarization sensitive. However, their retinal distribution and receptor characteristics have not been documented. Here, we used intracellular electrophysiology to determine the relationship between the spectral and polarization sensitivity of the photoreceptors and their position within the visual field of the ocelli. We first determined a photoreceptor's spectral response through a series of monochromatic flashes (340-600 nm). We found UV and green receptors, with peak sensitivities at 360 and 500 nm, respectively. We subsequently measured polarization sensitivity at the photoreceptor's peak sensitivity wavelength by rotating a polarizer with monochromatic flashes. Polarization sensitivity (PS) values were significantly higher in UV receptors (3.8±1.5, N=61) than in green receptors (2.1±0.6, N=60). Interestingly, most receptors with receptive fields below 35 deg elevation were sensitive to vertically polarized light while the receptors with visual fields above 35 deg were sensitive to a wide range of polarization angles. These results agree well with anatomical measurements showing differences in rhabdom orientations between dorsal and ventral retinae. We discuss the functional significance of the distribution of polarization sensitivities across the visual field of ocelli by highlighting the information the ocelli are able to extract from the bee's visual environment.

Head roll stabilisation in the nocturnal bull ant Myrmecia pyriformis: implications for visual navigation.

Ant foragers are known to memorise visual scenes that allow them to repeatedly travel along idiosyncratic routes and to return to specific places. Guidance is provided by a comparison between visual memories and current views, which critically depends on how well the attitude of the visual system is controlled. Here we show that nocturnal bull ants stabilise their head to varying degrees against locomotion-induced body roll movements, and this ability decreases as light levels fall. There are always un-compensated head roll oscillations that match the frequency of the stride cycle. Head roll stabilisation involves both visual and non-visual cues as ants compensate for body roll in complete darkness and also respond with head roll movements when confronted with visual pattern oscillations. We show that imperfect head roll control degrades navigation-relevant visual information and discuss ways in which navigating ants may deal with this problem.

Light and dark adaptation mechanisms in the compound eyes of Myrmecia ants that occupy discrete temporal niches.

Ants of the Australian genus Myrmecia partition their foraging niche temporally, allowing them to be sympatric with overlapping foraging requirements. We used histological techniques to study the light and dark adaptation mechanisms in the compound eyes of diurnal (Myrmecia croslandi), crepuscular (M. tarsata, M. nigriceps) and nocturnal ants (M. pyriformis). We found that, except in the day-active species, all ants have a variable primary pigment cell pupil that constricts the crystalline cone in bright light to control for light flux. We show for the nocturnal M. pyriformis that the constriction of the crystalline cone by the primary pigment cells is light dependent whereas the opening of the aperture is regulated by an endogenous rhythm. In addition, in the light-adapted eyes of all species, the retinular cell pigment granules radially migrate towards the rhabdom, a process that in both the day-active M. croslandi and the night-active M. pyriformis is driven by ambient light intensity. Visual system properties thus do not restrict crepuscular and night-active ants to their temporal foraging niche, while day-active ants require high light intensities to operate. We discuss the ecological significance of these adaptation mechanisms and their role in temporal niche partitioning.

Three spectrally distinct photoreceptors in diurnal and nocturnal Australian ants.

Ants are thought to be special among Hymenopterans in having only dichromatic colour vision based on two spectrally distinct photoreceptors. Many ants are highly visual animals, however, and use vision extensively for navigation. We show here that two congeneric day- and night-active Australian ants have three spectrally distinct photoreceptor types, potentially supporting trichromatic colour vision. Electroretinogram recordings show the presence of three spectral sensitivities with peaks (λmax) at 370, 450 and 550 nm in the night-active Myrmecia vindex and peaks at 370, 470 and 510 nm in the day-active Myrmecia croslandi. Intracellular electrophysiology on individual photoreceptors confirmed that the night-active M. vindex has three spectral sensitivities with peaks (λmax) at 370, 430 and 550 nm. A large number of the intracellular recordings in the night-active M. vindex show unusually broad-band spectral sensitivities, suggesting that photoreceptors may be coupled. Spectral measurements at different temporal frequencies revealed that the ultraviolet receptors are comparatively slow. We discuss the adaptive significance and the probability of trichromacy in Myrmecia ants in the context of dim light vision and visual navigation.

Three-dimensional models of natural environments and the mapping of navigational information.

Much evidence has accumulated in recent years, demonstrating that the degree to which navigating insects rely on path integration or landmark guidance when displaced depends on the navigational information content of their specific habitat. There is thus a need to quantify this information content. Here we present one way of achieving this by constructing 3D models of natural environments using a laser scanner and purely camera-based methods that allow us to render panoramic views at any location. We provide (1) ground-truthing of such reconstructed views against panoramic images recorded at the same locations; (2) evidence of their potential to map the navigational information content of natural habitats; (3) methods to register these models with GPS or with stereo camera recordings and (4) examples of their use in reconstructing the visual information available to walking and flying insects. We discuss the current limitations of 3D modelling, including the lack of spectral and polarisation information, but also the opportunities such models offer to map the navigational information content of natural habitats and to test visual navigation algorithms under 'real-life' conditions.

Mapping the navigational knowledge of individually foraging ants, Myrmecia croslandi.

Ants are efficient navigators, guided by path integration and visual landmarks. Path integration is the primary strategy in landmark-poor habitats, but landmarks are readily used when available. The landmark panorama provides reliable information about heading direction, routes and specific location. Visual memories for guidance are often acquired along routes or near to significant places. Over what area can such locally acquired memories provide information for reaching a place? This question is unusually approachable in the solitary foraging Australian jack jumper ant, since individual foragers typically travel to one or two nest-specific foraging trees. We find that within 10 m from the nest, ants both with and without home vector information available from path integration return directly to the nest from all compass directions, after briefly scanning the panorama. By reconstructing panoramic views within the successful homing range, we show that in the open woodland habitat of these ants, snapshot memories acquired close to the nest provide sufficient navigational information to determine nest-directed heading direction over a surprisingly large area, including areas that animals may have not visited previously.

Systematic variations in microvilli banding patterns along fiddler crab rhabdoms.

Polarisation sensitivity is based on the regular alignment of dichroic photopigment molecules within photoreceptor cells. In crustaceans, this is achieved by regularly stacking photopigment-rich microvilli in alternating orthogonal bands within fused rhabdoms. Despite being critical for the efficient detection of polarised light, very little research has focused on the detailed arrangement of these microvilli bands. We report here a number of hitherto undescribed, but functionally relevant changes in the organisation of microvilli banding patterns, both within receptors, and across the compound eye of fiddler crabs. In all ommatidia, microvilli bands increase in length from the distal to the proximal ends of the rhabdom. In equatorial rhabdoms, horizontal bands increase gradually from 3 rows of microvilli distally to 20 rows proximally. In contrast, vertical equatorial microvilli bands contain 15-20 rows of microvilli in the distal 30 µm of the rhabdom, shortening to 10 rows over the next 30 µm and then increase in length to 20 rows in parallel with horizontal bands. In the dorsal eye, horizontal microvilli occupy only half the cross-sectional area as vertical microvilli bands. Modelling absorption along the length of fiddler crab rhabdoms suggests that (1) increasing band length assures that photon absorption probability per band remains constant along the length of photoreceptors, indicating that individual bands may act as units of transduction or adaptation; (2) the different organisation of microvilli bands in equatorial and dorsal rhabdoms tune receptors to the degree and the information content of polarised light in the environment.

Feed-forward and visual feedback control of head roll orientation in wasps (Polistes humilis, Vespidae, Hymenoptera).

Flying insects keep their visual system horizontally aligned, suggesting that gaze stabilization is a crucial first step in flight control. Unlike flies, hymenopteran insects such as bees and wasps do not have halteres that provide fast, feed-forward angular rate information to stabilize head orientation in the presence of body rotations. We tested whether hymenopteran insects use inertial (mechanosensory) information to control head orientation from other sources, such as the wings, by applying periodic roll perturbations to male Polistes humilis wasps flying in tether under different visual conditions indoors and in natural outdoor conditions. We oscillated the thorax of the insects with frequency-modulated sinusoids (chirps) with frequencies increasing from 0.2 to 2 Hz at a maximal amplitude of 50 deg peak-to-peak and maximal angular velocity of ±245 deg s(-1). We found that head roll stabilization is best outdoors, but completely absent in uniform visual conditions and in darkness. Step responses confirm that compensatory head roll movements are purely visually driven. Modelling step responses indicates that head roll stabilization is achieved by merging information on head angular velocity, presumably provided by motion-sensitive neurons and information on head orientation, presumably provided by light level integration across the compound eyes and/or ocelli (dorsal light response). Body roll in free flight reaches amplitudes of ±40 deg and angular velocities greater than 1000 deg s(-1), while head orientation remains horizontal for most of the time to within ±10 deg. In free flight, we did not find a delay between spontaneous body roll and compensatory head movements, and suggest that this is evidence for the contribution of a feed-forward control to head stabilization.

Digger wasps Microbembex monodonta SAY (Hymenoptera, Crabronidae) rely exclusively on visual cues when pinpointing their nest entrances.

The ability of insects to navigate and home is crucial to fundamental tasks, such as pollination, parental care, procuring food, and finding mates. Despite recent advances in our understanding of visual homing in insects, it remains unclear exactly how ground-nesting Hymenoptera are able to precisely locate their often inconspicuous or hidden reproductive burrow entrances. Here we show that the ground-nesting wasp Microbembex monodonta locates her hidden burrow entrance with the help of local landmarks, but only if their view of the wider panorama is not blocked. Moreover, the wasps are able to pinpoint the burrow location to within a few centimeters when potential olfactory, tactile and auditory cues are locally masked. We conclude that M. monodonta locate their hidden burrows relying exclusively on local visual cues in the context of the wider panorama. We discuss these results in the light of the older and more recent literature on nest recognition and homing in insects.

Camera-based automated monitoring of flying insects (Camfi). I. Field and computational methods.

The ability to measure flying insect activity and abundance is important for ecologists, conservationists and agronomists alike. However, existing methods are laborious and produce data with low temporal resolution (e.g. trapping and direct observation), or are expensive, technically complex, and require vehicle access to field sites (e.g. radar and lidar entomology). We propose a method called "Camfi" for long-term non-invasive population monitoring and high-throughput behavioural observation of low-flying insects using images and videos obtained from wildlife cameras, which are inexpensive and simple to operate. To facilitate very large monitoring programs, we have developed and implemented a tool for automatic detection and annotation of flying insect targets in still images or video clips based on the popular Mask R-CNN framework. This tool can be trained to detect and annotate insects in a few hours, taking advantage of transfer learning. Our method will prove invaluable for ongoing efforts to understand the behaviour and ecology of declining insect populations and could also be applied to agronomy. The method is particularly suited to studies of low-flying insects in remote areas, and is suitable for very large-scale monitoring programs, or programs with relatively low budgets.

Camera-based automated monitoring of flying insects in the wild (Camfi). II. flight behaviour and long-term population monitoring of migratory Bogong moths in Alpine Australia.

Introduction: The Bogong moth Agrotis infusa is well known for its remarkable annual round-trip migration from its breeding grounds across eastern and southern Australia to its aestivation sites in the Australian Alps, to which it provides an important annual influx of nutrients. Over recent years, we have benefited from a growing understanding of the navigational abilities of the Bogong moth. Meanwhile, the population of Bogong moths has been shrinking. Recently, the ecologically and culturally important Bogong moth was listed as endangered by the IUCN Red List, and the establishment of a program for long-term monitoring of its population has been identified as critical for its conservation. Methods: Here, we present the results of two years of monitoring of the Bogong moth population in the Australian Alps using recently developed methods for automated wildlife-camera monitoring of flying insects, named Camfi. While in the Alps, some moths emerge from the caves in the evening to undertake seemingly random flights, filling the air with densities in the dozens per cubic metre. The purpose of these flights is unknown, but they may serve an important role in Bogong moth navigation. Results: We found that these evening flights occur throughout summer and are modulated by daily weather factors. We present a simple heuristic model of the arrival to and departure from aestivation sites by Bogong moths, and confirm results obtained from fox-scat surveys which found that aestivating Bogong moths occupy higher elevations as the summer progresses. Moreover, by placing cameras along two elevational transects below the summit of Mt. Kosciuszko, we found that evening flights were not random, but were systematically oriented in directions relative to the azimuth of the summit of the mountain. Finally, we present the first recorded observations of the impact of bushfire smoke on aestivating Bogong moths - a dramatic reduction in the size of a cluster of aestivating Bogong moths during the fire, and evidence of a large departure from the fire-affected area the day after the fire. Discussion: Our results highlight the challenges of monitoring Bogong moths in the wild and support the continued use of automated camera-based methods for that purpose.

Anesthesia disrupts distance, but not direction, of path integration memory.

Solitary foraging insects, such as ants, maintain an estimate of the direction and distance to their starting location as they move away from it, in a process known as path integration. This estimate, commonly known as the "home vector," is updated continuously as the ant moves1-4 and is reset as soon as it enters its nest,5 yet ants prevented from returning to their nest can still use their home vector when released several hours later.6,7 This conjunction of fast update and long persistence of the home vector memory does not directly map to existing accounts of short-, mid-, and long-term memory;2,8-12 hence, the substrate of this memory remains unknown. Chill-coma anesthesia13-15 has previously been shown to affect associative memory retention in fruit flies14,16 and honeybees.9,17,18 We investigate the nature of path integration memory by anesthetizing ants after they have accumulated home vector information and testing if the memory persists on recovery. We show that after anesthesia the memory of the distance ants have traveled is degraded, but the memory of the direction is retained. We also show that this is consistent with models of path integration that maintain the memory in a redundant Cartesian coordinate system and with the hypothesis that chill-coma produces a proportional reduction of the memory, rather than a subtractive reduction or increase of noise. The observed effect is not compatible with a memory based on recurrent circuit activity and points toward an activity-dependent molecular process as the basis of path integration memory.