Automatic object detection for behavioural research using YOLOv8.

Observational studies of human behaviour often require the annotation of objects in video recordings. Automatic object detection has been facilitated strongly by the development of YOLO ('you only look once') and particularly by YOLOv8 from Ultralytics, which is easy to use. The present study examines the conditions required for accurate object detection with YOLOv8. The results show almost perfect object detection even when the model was trained on a small dataset (100 to 350 images). The detector, however, does not extrapolate well to the same object in other backgrounds. By training the detector on images from a variety of backgrounds, excellent object detection can be restored. YOLOv8 could be a game changer for behavioural research that requires object annotation in video recordings.

The construct validity of attitudes toward sex offenders (ATS) scale: ATS is more strongly linked to the acceptance of sex offenders than other offenders or non-offenders.

Negative attitudes toward offenders may hinder the rehabilitation process. The present study examines the relationship between attitudes toward sex offenders and stated acceptance of offenders and non-offenders into various aspects of daily life. Sixty female members of the public (18-50 years old, UK residents, recruited by word of mouth and via social media) completed an attitudes towards sex offenders (ATS) scale and indicated for each of eight vignettes describing ex-offenders and non-offenders whether they would accept them in various situations (housing, employment, day-to-day activities). Results indicate that in this group of female participants, harsher attitudes toward sex offenders are associated with lower acceptance of sex offenders (around 50% less acceptance) and other offenders (around 25% less acceptance), but not non-offenders, suggesting a tight coupling between attitudes and acceptance. The observed coupling between attitudes toward sex offenders and acceptance of offenders suggests that it will be difficult to change one without changing the other.

The Influence of Competing Social and Symbolic Cues on Observers' Gaze Behaviour.

The effects of social (eye gaze, pointing gestures) and symbolic (arrows) cues on observers' attention are often studied by presenting such cues in isolation and at fixation. Here, we extend this work by embedding cues in natural scenes. Participants were presented with a single cue (Experiment 1) or a combination of cues (Experiment 2) embedded in natural scenes and were asked to 'simply look at the images' while their eye movements were recorded to assess the effects of the cues on (overt) attention. Single-gaze and pointing cues were fixated for longer than arrows but at the cost of shorter dwell times on the cued object. When presented together, gaze and pointing cues were fixated faster and for longer than simultaneously presented arrows. Attention to the cued object depended on the combination of cues and whether both cues were directed towards or away from the target object. Together, the findings confirm earlier observations that people attract attention more strongly than arrows but that arrows more strongly direct attention.

Gaze-speech coordination during social interaction in Parkinson's disease.

BACKGROUND: Parkinson's disease (PD) can affect social interaction and communication as well as motor and cognitive processes. Speech is affected in PD, as is the control of voluntary eye movements which are thought to play an important role in 'turn taking' in conversation. AIMS: This study aimed to measure eye movements during spoken conversation in PD to assess whether differences in patterns of eye gaze are linked to disrupted turn taking and impaired communication efficiency. METHODS & PROCEDURE: Eleven participants with mild PD and 14 controls completed a two-player guessing game. During each 3 min game turn, one of the players had to guess the names of as many objects as possible based only on the other player's description. Eye movements were recorded simultaneously in both participants using mobile eye trackers along with speech onset and offset times. OUTCOMES & RESULTS: When people with PD played the role of describer, the other player guessed fewer objects compared to when controls described objects. When guessing objects, people with PD performed just as well as controls. Analysis of eye fixations showed that people with PD made longer periods of fixation on the other player's face relative to controls and a lower number of such 'gaze on face' periods. CONCLUSIONS & IMPLICATIONS: A combination of oculomotor, cognitive and speech abnormalities may disrupt communication in PD. Better public awareness of oculomotor, speech and other deficits in the condition could improve social connectedness in people with Parkinson's. WHAT THIS PAPER ADDS: What is already known on this subject? Parkinson's disease is known to affect the control of voluntary eye movements. Direction of eye gaze is important in spoken conversation as a cue to turn-taking, but no studies have examined whether eye movements are different during communication in people with Parkinson's. What this paper adds to existing knowledge? People with Parkinson's showed longer periods of eye fixation during conversations compared to controls. Delays and overlaps between speech turns were also affected in patients. What are the clinical implications of this work? Better knowledge of the effect of the disease on eye gaze control amongst clinicians may help improve communication and social connectedness for patients in the future.

Thinking on your feet: Anticipatory foot placements in repeated bimanual object displacements.

Effective handling of objects requires proper use of the hands. If the object handling is done while standing or walking, it also requires proper use of the feet. We asked how people position their feet to meet future and ongoing object-handling demands. In previous research on this topic, participants walked to a table and picked up an object for a single displacement from one place to another. These studies shed light on sensitivity to kinematics but, strictly speaking, may not have revealed anything about sensitivity to dynamics. In the present study, we asked participants to walk to a table to move an object back and forth over different distances and at different rates. Prior to walking to the table, participants had full knowledge of what the task would be. By using a rhythmic rather than discrete object placement task, we could analyze participants' sensitivity to dynamics as well as kinematics. Consistent with our expectation that participants would tune their foot separations to demands related to dynamics, we found that stance width was wider for long than for short object displacements and was more pronounced for high displacement rates than for low displacement rates. Also consistent with our expectations about planning, these effects were evident as soon as participants reached the table. Our results add to the limited research on coordinated action of the hands and feet in purposeful object manipulation.

Visual attention in change blindness for objects and shadows.

Studies have found that observers pay less attention to cast shadows in images than to better illuminated regions. In line with such observations, a recent study has suggested stronger change blindness for shadows than for objects (Ehinger et al., 2016). We here examine the role of (overt) visual attention in these findings by recording participants' eye movements. Participants first viewed all original images (without changes). They then performed a change detection task on a subset of the images with changes in objects or shadows. During both tasks, their eye movements were recorded. In line with the original study, objects (subject to change in the change detection task) were fixated more often than shadows. In contrast to the previous study, better change detection was found for shadows than for objects. The improved change detection for shadows may be explained by the balancing of trials with object and shadow changes in the present study. Eye movements during change detection indicated that participants searched the bottom half of the images. Shadows were more often present in this region, which may explain why they were easier to find.

Data-driven group comparisons of eye fixations to dynamic stimuli.

Recent advances in software and hardware have allowed eye tracking to move away from static images to more ecologically relevant video streams. The analysis of eye tracking data for such dynamic stimuli, however, is not without challenges. The frame-by-frame coding of regions of interest (ROIs) is labour-intensive and computer vision techniques to automatically code such ROIs are not yet mainstream, restricting the use of such stimuli. Combined with the more general problem of defining relevant ROIs for video frames, methods are needed that facilitate data analysis. Here, we present a first evaluation of an easy-to-implement data-driven method with the potential to address these issues. To test the new method, we examined the differences in eye movements of self-reported politically left- or right-wing leaning participants to video clips of left- and right-wing politicians. The results show that our method can accurately predict group membership on the basis of eye movement patterns, isolate video clips that best distinguish people on the political left-right spectrum, and reveal the section of each video clip with the largest group differences. Our methodology thereby aids the understanding of group differences in gaze behaviour, and the identification of critical stimuli for follow-up studies or for use in saccade diagnosis.

The effect of directional social cues on saccadic eye movements in Parkinson's disease.

There is growing interest in how social processes and behaviour might be affected in Parkinson's disease. A task which has been widely used to assess how people orient attention in response to social cues is the spatial cueing task. Socially relevant directional cues, such as a picture of someone gazing or pointing to the left or the right have been shown to cause orienting of visual attention in the cued direction. The basal ganglia may play a role in responding to such directional cues, but no studies to date have examined whether similar social cueing effects are seen in people with Parkinson's disease. In this study, patients and healthy controls completed a prosaccade (Experiment 1) and an antisaccade task (Experiment 2) in which the target was preceded by arrow, eye gaze or pointing finger cues. Patients showed increased errors and response times for antisaccades but not prosaccades. Healthy participants made most anticipatory errors on pointing finger cue trials, but Parkinson's patients were equally affected by arrow, eye gaze and pointing cues. It is concluded that Parkinson's patients have a reduced ability to suppress responding to directional cues, but this effect is not specific to social cues.

Face and word composite effects are similarly affected by priming of local and global processing.

Holistic processing has been shown with both faces and words, but it is unclear how similar their underlying mechanisms are. In this study attention to global and local features was manipulated and the consequences for holistic word and face processing were examined. On each trial participants were presented two Navon figures and told to focus on either the global or the local level. Then they performed a composite task in which they indicated whether the target halves of two sequentially presented faces or words were the same or different, ignoring the irrelevant halves. Similar stronger global priming effects were found for faces and words, indicating that holistic processing for the two types of stimuli were susceptible to attention manipulations to similar degrees, which was confirmed with Bayesian analyses. The findings add to the investigation of the similarity and differences between holistic processing and help reveal those aspects of holistic processing that are domain general and those specific to individual categories.

Does agreement mean accuracy? Evaluating glance annotation in naturalistic driving data.

Naturalistic driving studies often make use of cameras to monitor driver behavior. To analyze the resulting video images, human annotation is often adopted. These annotations then serve as the 'gold standard' to train and evaluate automated computer vision algorithms, even though it is uncertain how accurate human annotation is. In this study, we provide a first evaluation of glance direction annotation by comparing instructed, actual glance direction of truck drivers with annotated direction. Findings indicate that while for some locations high annotation accuracy is achieved, for most locations accuracy is well below 50%. Higher accuracy can be obtained by clustering these locations, but this also leads to reduced detail of the annotation, suggesting that decisions to use clustering should take into account the purpose of the annotation. The data also show that high agreement between annotators does not guarantee high accuracy. We argue that the accuracy of annotation needs to be verified experimentally more often.

Eye Movements in Neuropsychological Tasks.

This chapter reviews how recording and analysis of eye movements have been applied to understanding cognitive functioning in patients with neurological disease. Measures derived from the performance of instructed eye movement tests such as the anti-saccade and memory-guided saccade tasks have been shown to be associated with cognitive test performance and the early stages of neurodegenerative disorders including Alzheimer's and Parkinson's disease. Other researchers have taken an ecological approach and recorded the uninstructed pattern of saccades made by patients during performance of established neuropsychological tasks. Studies that have analysed the eye movement strategies used in a number of widely used tests are reviewed, including the Corsi blocks, Tower of London, 'CANTAB' Spatial Working Memory and Brixton Spatial Anticipation test. The findings illustrate that eye movements are not purely in the service of vision, but support visuospatial working memory and forward action planning. Eye movement tests and measures also have potential for application in the assessment and diagnosis of neurological disease and cognitive impairment. Establishing large-scale normative data sets in healthy older adults and use of machine learning multivariate classifier algorithms may be key to further developing eye tracking applications in neuropsychological assessment.

Does it look safe? An eye tracking study into the visual aspects of fear of crime.

Studies of fear of crime often focus on demographic and social factors, but these can be difficult to change. Studies of visual aspects have suggested that features reflecting incivilities, such as litter, graffiti, and vandalism increase fear of crime, but methods often rely on participants actively mentioning such aspects, and more subtle, less conscious aspects may be overlooked. To address these concerns, this study examined people's eye movements while they judged scenes for safety. In total, 40 current and former university students were asked to rate images of day-time and night-time scenes of Lincoln, UK (where they studied) and Egham, UK (unfamiliar location) for safety, maintenance, and familiarity while their eye movements were recorded. Another 25 observers not from Lincoln or Egham rated the same images in an Internet survey. Ratings showed a strong association between safety and maintenance and lower safety ratings for night-time scenes for both groups, in agreement with earlier findings. Eye movements of the Lincoln participants showed increased dwell times on buildings, houses, and vehicles during safety judgements and increased dwell times on streets, pavements, and markers of incivilities for maintenance. Results confirm that maintenance plays an important role in perceptions of safety, but eye movements suggest that observers also look for indicators of current or recent presence of people.

Eye Movements in the "Morris Maze" Spatial Working Memory Task Reveal Deficits in Strategic Planning.

Analysis of eye movements can provide insights into processes underlying performance of cognitive tasks. We recorded eye movements in healthy participants and people with idiopathic Parkinson disease during a token foraging task based on the spatial working memory component of the widely used Cambridge Neuropsychological Test Automated Battery. Participants selected boxes (using a mouse click) to reveal hidden tokens. Tokens were never hidden under a box where one had been found before, such that memory had to be used to guide box selections. A key measure of performance in the task is between search errors (BSEs) in which a box where a token has been found is selected again. Eye movements were found to be most commonly directed toward the next box to be clicked on, but fixations also occurred at rates higher than expected by chance on boxes farther ahead or back along the search path. Looking ahead and looking back in this way was found to correlate negatively with BSEs and was significantly reduced in patients with Parkinson disease. Refixating boxes where tokens had already been found correlated with BSEs and the severity of Parkinson disease symptoms. It is concluded that eye movements can provide an index of cognitive planning in the task. Refixations on locations where a token has been found may also provide a sensitive indicator of visuospatial memory integrity. Eye movement measures derived from the spatial working memory task may prove useful in the assessment of executive functions as well as neurological and psychiatric diseases in the future.

Eye movements while judging faces for trustworthiness and dominance.

Past studies examining how people judge faces for trustworthiness and dominance have suggested that they use particular facial features (e.g. mouth features for trustworthiness, eyebrow and cheek features for dominance ratings) to complete the task. Here, we examine whether eye movements during the task reflect the importance of these features. We here compared eye movements for trustworthiness and dominance ratings of face images under three stimulus configurations: Small images (mimicking large viewing distances), large images (mimicking face to face viewing), and a moving window condition (removing extrafoveal information). Whereas first area fixated, dwell times, and number of fixations depended on the size of the stimuli and the availability of extrafoveal vision, and varied substantially across participants, no clear task differences were found. These results indicate that gaze patterns for face stimuli are highly individual, do not vary between trustworthiness and dominance ratings, but are influenced by the size of the stimuli and the availability of extrafoveal vision.

When do arrows start to compete? A developmental mouse-tracking study.

Recent work in adults has suggested that the strength of social and symbolic cues not presented at fixation (but allowing eye movements to the cue) may be determined less by their biological relevance and more by the distinctiveness of the shape of the cue. The present study examines whether these results extend to children, who may differ in their relative exposure to symbolic cues (arrows) compared to social cues. Children aged 3 to 11 were presented with congruent or incongruent pairs of cues (line drawings of gazing eyes, pointing hands, and arrows) and were asked to indicate the direction of the target cue (indicated at the start of the block) by moving the mouse towards the response box indicating its direction. Results show a similar advantage for arrows and pointing hands in young children as previously found in adults, suggesting that cue shape trumps biological relevance for cues away from fixation from an early age.

The eyes have it: Using eye tracking to inform information processing strategies in multi-attributes choices.

Although choice experiments (CEs) are widely applied in economics to study choice behaviour, understanding of how individuals process attribute information remains limited. We show how eye-tracking methods can provide insight into how decisions are made. Participants completed a CE, while their eye movements were recorded. Results show that although the information presented guided participants' decisions, there were also several processing biases at work. Evidence was found of (a) top-to-bottom, (b) left-to-right, and (c) first-to-last order biases. Experimental factors-whether attributes are defined as "best" or "worst," choice task complexity, and attribute ordering-also influence information processing. How individuals visually process attribute information was shown to be related to their choices. Implications for the design and analysis of CEs and future research are discussed.

Mind Your Step: the Effects of Mobile Phone Use on Gaze Behavior in Stair Climbing.

Stair walking is a hazardous activity and a common cause of fatal and non-fatal falls. Previous studies have assessed the role of eye movements in stair walking by asking people to repeatedly go up and down stairs in quiet and controlled conditions, while the role of peripheral vision was examined by giving participants specific fixation instructions or working memory tasks. We here extend this research to stair walking in a natural environment with other people present on the stairs and a now common secondary task: using one's mobile phone. Results show that using the mobile phone strongly draws one's attention away from the stairs, but that the distribution of gaze locations away from the phone is little influenced by using one's phone. Phone use also increased the time needed to walk the stairs, but handrail use remained low. These results indicate that limited foveal vision suffices for adequate stair walking in normal environments, but that mobile phone use has a strong influence on attention, which may pose problems when unexpected obstacles are encountered.

Responding to social and symbolic extrafoveal cues: cue shape trumps biological relevance.

Social cues presented at visual fixation have been shown to strongly influence an observer's attention and response selection. Here we ask whether the same holds for cues (initially) presented away from fixation, as cues are commonly perceived in natural vision. In six experiments, we show that extrafoveally presented cues with a distinct outline, such as pointing hands, rotated heads, and arrow cues result in strong cueing of responses (either to the cue itself, or a cued object). In contrast, cues without a clear outline, such as gazing eyes and direction words exert much weaker effects on participants' responses to a target cue. We also show that distraction effects on response times are relatively weak, but that strong interference effects can be obtained by measuring mouse trajectories. Eye tracking suggests that gaze cues are slower to respond to because their direction cannot easily be perceived in extrafoveal vision. Together, these data suggest that the strength of an extrafoveal cue is determined by the shape of the cue outline, rather than its biological relevance (i.e., whether the cue is provided by another human being), and that this shape effect is due to how easily the direction of a cue can be perceived in extrafoveal vision.

Age-congruency and contact effects in body expression recognition from point-light displays (PLD).

Recognition of older people's body expressions is a crucial social skill. We here investigate how age, not just of the observer, but also of the observed individual, affects this skill. Age may influence the ability to recognize other people's body expressions by changes in one's own ability to perform certain action over the life-span (i.e., an own-age bias may occur, with best recognition for one's own age). Whole body point light displays of children, young adults and older adults (>70 years) expressing six different emotions were presented to observers of the same three age-groups. Across two variations of the paradigm, no evidence for the predicted own-age bias (a cross-over interaction between one's own age and the observed person's age) was found. Instead, experience effects were found with children better recognizing older actors' expressions of 'active emotions,' such as anger and happiness with greater exposure in daily life. Together, the findings suggest that age-related changes in one own's mobility only influences body expression categorization in young children who interact frequently with older adults.

Eye Movements in Risky Choice.

We asked participants to make simple risky choices while we recorded their eye movements. We built a complete statistical model of the eye movements and found very little systematic variation in eye movements over the time course of a choice or across the different choices. The only exceptions were finding more (of the same) eye movements when choice options were similar, and an emerging gaze bias in which people looked more at the gamble they ultimately chose. These findings are inconsistent with prospect theory, the priority heuristic, or decision field theory. However, the eye movements made during a choice have a large relationship with the final choice, and this is mostly independent from the contribution of the actual attribute values in the choice options. That is, eye movements tell us not just about the processing of attribute values but also are independently associated with choice. The pattern is simple-people choose the gamble they look at more often, independently of the actual numbers they see-and this pattern is simpler than predicted by decision field theory, decision by sampling, and the parallel constraint satisfaction model. © 2015 The Authors. Journal of Behavioral Decision Making published by John Wiley & Sons Ltd.