The Perception of Automation Reliability and Acceptance of Automated Advice.

OBJECTIVE: Examine (1) the extent to which humans can accurately estimate automation reliability and calibrate to changes in reliability, and how this is impacted by the recent accuracy of automation; and (2) factors that impact the acceptance of automated advice, including true automation reliability, reliability perception, and the difference between an operator's perception of automation reliability and perception of their own reliability. BACKGROUND: Existing evidence suggests humans can adapt to changes in automation reliability but generally underestimate reliability. Cognitive science indicates that humans heavily weight evidence from more recent experiences. METHOD: Participants monitored the behavior of maritime vessels (contacts) in order to classify them, and then received advice from automation regarding classification. Participants were assigned to either an initially high (90%) or low (60%) automation reliability condition. After some time, reliability switched to 75% in both conditions. RESULTS: Participants initially underestimated automation reliability. After the change in true reliability, estimates in both conditions moved towards the common true reliability, but did not reach it. There were recency effects, with lower future reliability estimates immediately following incorrect automation advice. With lower initial reliability, automation acceptance rates tracked true reliability more closely than perceived reliability. A positive difference between participant assessments of the reliability of automation and their own reliability predicted greater automation acceptance. CONCLUSION: Humans underestimate the reliability of automation, and we have demonstrated several critical factors that impact the perception of automation reliability and automation use. APPLICATION: The findings have potential implications for training and adaptive human-automation teaming.

Durability of treatment effects following internet-delivered cognitive behavioural therapy for depression and anxiety delivered within a routine care setting.

OBJECTIVE: To investigate post-treatment relapse and remission rates 3, 6 and 9 months after completion of an acute phase of a clinician-supported internet-delivered cognitive-behavioural therapy (iCBT) for anxiety and depressive symptoms, within a routine care setting. METHOD: Secondary analysis from a 12-month pragmatic randomized-controlled trial delivered within the Improving Access to Psychological Therapies (IAPT) programme in England. Participants in the intervention arm were included if they met criteria for reliable recovery from depression (PHQ-9) and anxiety (GAD-7) at post-treatment assessment. Survival analysis was used to assess durability of treatment effects and determine predictors to relapse at 3-, 6- and 9-month follow-up. Hazard ratios predicting time-to-relapse were estimated with semi-parametric Cox proportional hazards model. RESULTS: Of the 241 participants in the intervention arm, 89 participants met the criteria for reliable recovery from depression and anxiety at the post-treatment assessment. Of these 89 eligible cases, 29.2% relapsed within the 9-month period, with 70.8% remaining in remission at 9 months post-treatment. Of those who relapsed, 53.8% experienced a relapse of depression and anxiety; 7.7% experienced a relapse of depression only; and 38.4% experienced a relapse of anxiety only. Younger age, having a long-term condition, and residual symptoms of anxiety at end-of-treatment were all significant predictors of relapse. CONCLUSIONS: This study is the first to explore the remission and relapse rates after an acute phase of iCBT treatment, within a routine, stepped-care setting. The results add to the scarce literature on the durability of the effects of iCBT treatment in routine care settings, where patients are not typically followed up after receiving a completed course of treatment.

How do recall requirements affect decision-making in free recall initiation? A linear ballistic accumulator approach.

Models of free recall describe free recall initiation as a decision-making process in which items compete to be retrieved. Recently, Osth and Farrell (Psychological Review, 126, 578-609, 2019) applied evidence accumulation models to complete RT distributions and serial positions of participants' first recalls in free recall, which resulted in some novel conclusions about primacy and recency effects. Specifically, the results of the modeling favored an account in which primacy was due to reinstatement of the start-of-the-list, and recency was found to be exponential in shape. In this work, we examine what happens when participants are given alternative recall instructions. Prior work has demonstrated weaker primacy and greater recency when fewer items are required to report (Ward & Tan, Memory & Cognition, 2019), and a key question is whether this change in instructions qualitatively changes the nature of the recall process, or merely changes the parameters of the recall competition. We conducted an experiment where participants studied six- or 12-item lists and were post-cued as to whether to retrieve a single item, or as many items as possible. Subsequently, we applied LBA models with various assumptions about primacy and recency, implemented using hierarchical Bayesian techniques. While greater recency was observed when only one item was required for output, the model selection did not suggest that there were qualitative differences between the two conditions. Specifically, start-of-list reinstatement and exponential recency functions were favored in both conditions.

Prospective Memory Performance in Simulated Air Traffic Control : Robust to Interruptions but Impaired by Retention Interval.

OBJECTIVE: To examine the effects of interruptions and retention interval on prospective memory for deferred tasks in simulated air traffic control. BACKGROUND: In many safety-critical environments, operators need to remember to perform a deferred task, which requires prospective memory. Laboratory experiments suggest that extended prospective memory retention intervals, and interruptions in those retention intervals, could impair prospective memory performance. METHOD: Participants managed a simulated air traffic control sector. Participants were sometimes instructed to perform a deferred handoff task, requiring them to deviate from a routine procedure. We manipulated whether an interruption occurred during the prospective memory retention interval or not, the length of the retention interval (37-117 s), and the temporal proximity of the interruption to deferred task encoding and execution. We also measured performance on ongoing tasks. RESULTS: Increasing retention intervals (37-117 s) decreased the probability of remembering to perform the deferred task. Costs to ongoing conflict detection accuracy and routine handoff speed were observed when a prospective memory intention had to be maintained. Interruptions did not affect individuals' speed or accuracy on the deferred task. CONCLUSION: Longer retention intervals increase risk of prospective memory error and of ongoing task performance being impaired by cognitive load; however, prospective memory can be robust to effects of interruptions when the task environment provides cuing and offloading. APPLICATION: To support operators in performing complex and dynamic tasks, prospective memory demands should be reduced, and the retention interval of deferred tasks should be kept as short as possible.

Analyzing social media data: A mixed-methods framework combining computational and qualitative text analysis.

To qualitative researchers, social media offers a novel opportunity to harvest a massive and diverse range of content without the need for intrusive or intensive data collection procedures. However, performing a qualitative analysis across a massive social media data set is cumbersome and impractical. Instead, researchers often extract a subset of content to analyze, but a framework to facilitate this process is currently lacking. We present a four-phased framework for improving this extraction process, which blends the capacities of data science techniques to compress large data sets into smaller spaces, with the capabilities of qualitative analysis to address research questions. We demonstrate this framework by investigating the topics of Australian Twitter commentary on climate change, using quantitative (non-negative matrix inter-joint factorization; topic alignment) and qualitative (thematic analysis) techniques. Our approach is useful for researchers seeking to perform qualitative analyses of social media, or researchers wanting to supplement their quantitative work with a qualitative analysis of broader social context and meaning.

No evidence of binding items to spatial configuration representations in visual working memory.

When detecting changes in visual features (e.g., colour or shape), object locations, represented as points within a configuration, might also be automatically represented in working memory. If the configuration of a scene is represented automatically, the locations of individual items might form part of this representation, irrespective of their relevance to the task. Participants took part in a change-detection task in which they studied displays containing different sets of items (shapes, letters, objects), which varied in their task relevance. Specifically, they were asked to remember the features of two sets, and ignore the third set. During the retention interval, an audio cue indicated which of the to-be-remembered sets would become the target set (having a 50% probability of containing a new feature). At test, they were asked to indicate whether a new feature was present amongst the target set. We measured binding of individual items to the configuration by manipulating the locations of the different sets so that their position in the test display either matched or mismatched their original location in the study display. If items are automatically bound to the configuration, location changes should disrupt performance, even if they were explicitly instructed not to remember the features of that particular set of items. There was no effect on performance of changing the locations of any of the sets between study and test displays, indicating that the configural representation did not enter their decision stage, and therefore that individual item representations are not necessarily bound to the configuration.

No evidence for binding of items to task-irrelevant backgrounds in visual working memory.

When representing visual features such as color and shape in visual working memory (VWM), participants also represent the locations of those features as a spatial configuration of the locations of those features in the display. In everyday life, we encounter objects against some background, yet it is unclear whether the configural representation in memory obligatorily constitutes the entire display, including that (often task-irrelevant) background information. In three experiments, participants completed a change detection task on color and shape; the memoranda were presented in front of uniform gray backgrounds, a textured background (Exp. 1), or a background containing location placeholders (Exps. 2 and 3). When whole-display probes were presented, changes to the objects' locations or feature bindings impacted memory performance-implying that the spatial configuration of the probes influenced participants' change decisions. Furthermore, when only a single item was probed, the effect of changing its location or feature bindings was either diminished or completely extinguished, implying that single probes do not necessarily elicit the entire spatial configuration. Critically, when task-irrelevant backgrounds were also presented that may have provided a spatial configuration for the single probes, the effect of location or bindings was not moderated. These findings suggest that although the spatial configuration of a display guides VWM-based recognition, this information does not necessarily always influence the decision process during change detection.

Can the effects of temporal grouping explain the similarities and differences between free recall and serial recall?

Temporal grouping can provide a principled explanation for changes in the serial position curves and output orders that occur with increasing list length in immediate free recall (IFR) and immediate serial recall (ISR). To test these claims, we examined the effects of temporal grouping on the order of recall in IFR and ISR of lists of between one and 12 words. Consistent with prior research, there were significant effects of temporal grouping in the ISR task with mid-length lists using serial recall scoring, and no overall grouping advantage in the IFR task with longer list lengths using free recall scoring. In all conditions, there was a general tendency to initiate recall with either the first list item or with one of the last four items, and then to recall in a forward serial order. In the grouped IFR conditions, when participants started with one of the last four words, there were particularly heightened tendencies to initiate recall with the first item of the most recent group. Moreover, there was an increased degree of forward-ordered transitions within groups than across groups in IFR. These findings are broadly consistent with Farrell's model, in which lists of items in immediate memory are parsed into distinct groups and participants initiate recall with the first item of a chosen cluster, but also highlight shortcomings of that model. The data support the claim that grouping may offer an important element in the theoretical integration of IFR and ISR.

How do humans learn about the reliability of automation?

In a range of settings, human operators make decisions with the assistance of automation, the reliability of which can vary depending upon context. Currently, the processes by which humans track the level of reliability of automation are unclear. In the current study, we test cognitive models of learning that could potentially explain how humans track automation reliability. We fitted several alternative cognitive models to a series of participants' judgements of automation reliability observed in a maritime classification task in which participants were provided with automated advice. We examined three experiments including eight between-subjects conditions and 240 participants in total. Our results favoured a two-kernel delta-rule model of learning, which specifies that humans learn by prediction error, and respond according to a learning rate that is sensitive to environmental volatility. However, we found substantial heterogeneity in learning processes across participants. These outcomes speak to the learning processes underlying how humans estimate automation reliability and thus have implications for practice.

Sequential dependencies in recall of sequences: filling in the blanks.

Sequential dependencies can provide valuable information about the processes supporting memory, particularly memory for serial order. Earlier analyses have suggested that anticipation errors-reporting items ahead of their correct position in the sequence-tend to be followed by recall of the displaced item, consistent with primacy gradient models of serial recall. However, a more recent analysis instead suggests that anticipation errors are followed by further anticipation errors, consistent with chaining models. We report analyses of 21 conditions from published serial recall data sets, in which we observed a systematic pattern whereby anticipations tended to be followed by the "filling in" of displaced items. We note that cases where a different pattern held tended to apply to recall of longer lists under serial learning conditions or to conditions where participants were free to skip over items. Although the different patterns that can be observed might imply a dissociation (e.g., between short- and long-term memory), we show that these different patterns are naturally predicted by Farrell's (Psychological Review 119:223-271, 2012) model of short-term and episodic memory and relate to whether or not spontaneously formed groups of items can be skipped over during recall.

Influence of environmental statistics on inhibition of saccadic return.

Initiating an eye movement is slowed if the saccade is directed to a location that has been fixated in the recent past. We show that this inhibitory effect is modulated by the temporal statistics of the environment: If a return location is likely to become behaviorally relevant, inhibition of return is absent. By fitting an accumulator model of saccadic decision-making, we show that the inhibitory effect and the sensitivity to local statistics can be dissociated in their effects on the rate of accumulation of evidence, and the threshold controlling the amount of evidence needed to generate a saccade.

The role of episodic memory sampling in evaluation.

Many models of choice assume that people retrieve memories of past experiences and use them to guide evaluation and choice. In this paper, we examine whether samples of recalled past experiences do indeed underpin our evaluations of options. We showed participants sequences of numerical values and asked them to recall as many of those values as possible and also to state how much they would be willing to pay for another draw from the sequence. Using Bayesian mixed effects modeling, we predicted participants' evaluation of the sequences at the group level from either the average of the values they recalled or the average of the values they saw. Contrary to the predictions of recall-based models, people's evaluations appear to be sensitive to information beyond what was actually recalled. Moreover, we did not find consistent evidence that memory for specific items is sufficient to predict evaluation of sequences. We discuss the implications for sampling models of memory and decision-making and alternative explanations.

Response suppression contributes to recency in serial recall.

Serial recall is often assumed to involve response suppression: the removal or inhibition of items already recalled so that they are not recalled again. Evidence for response suppression includes repetition inhibition and the separation of erroneous repetitions. Some theorists have suggested that response suppression, by eliminating competing responses, also contributes to recency in forward serial recall. We present experiments in which performance on the final item was examined as a function of whether or not the preceding retrievals entailed suppression of potential response competitors. In line with the predictions of response suppression, recency was found to be reduced when the earlier recall errors consisted of intrusion errors (which leave list items unsuppressed) rather than transposition errors (which involve suppression).

Human behavioral response to fluctuating automation reliability.

Human perception of automation reliability and automation acceptance behaviours are key to effective human-automation teaming. This study examined factors that impact perceptions of automation reliability over time and the acceptance of automated advice. Participants completed a maritime vessel classification task in which they classified vessels (contacts) with the assistance of automation. In Experiment 1 automation reliability successively switched from high to low (or vice versa). In Experiment 2 automation reliability decreased by varying magnitudes before returning to high. Participants did not initially calibrate to true reliability and experiencing low automation reliability reduced future reliability estimates when experiencing subsequent high reliability. Automation acceptance was predicted by positive differences between participant perception of automation reliability and confidence in their own manual classification reliability. Experiencing low automation reliability caused perceptions of reliability and automation acceptance rates to diverge. These findings have important implications for training and adaptive human-automation teaming in complex work environments.

Evidence Against Novelty-Gated Encoding in Serial Recall.

Novelty-gated encoding is the assumption that events are encoded more strongly into memory when they are more novel in comparison to previously encoded events. It is a core assumption of the SOB model of serial recall (Farrell & Lewandowsky, 2002). We present three experiments testing some predictions from novelty-gated encoding. Experiment 1 shows that the probability of recalling the third item in a list correctly does not depend on whether it is preceded by phonologically similar or dissimilar items. Experiment 2 shows that in lists of items from three classes (nonwords, spatial locations, and abstract drawings) the probability of recalling an item does not depend on whether it is preceded by items from the same or another class. Experiment 3 used a complex-span paradigm varying the phonological similarity of words that are read aloud as distractors in between memory items. Contrary to a prediction from novelty-gated encoding, similar distractors did not impair memory more than dissimilar distractors. The results question the assumption of novelty-gated encoding in serial recall. We discuss alternative explanations for the phenomena that this assumption has previously helped to explain. The present evidence against novelty-gated encoding might point to boundary conditions for the role of prediction error in the acquisition of memories.

Examining the role of information integration in the continued influence effect using an event segmentation approach.

Misinformation regarding the cause of an event often continues to influence an individual's event-related reasoning, even after they have received a retraction. This is known as the continued influence effect (CIE). Dominant theoretical models of the CIE have suggested the effect arises primarily from failures to retrieve the correction. However, recent research has implicated information integration and memory updating processes in the CIE. As a behavioural test of integration, we applied an event segmentation approach to the CIE paradigm. Event segmentation theory suggests that incoming information is parsed into distinct events separated by event boundaries, which can have implications for memory. As such, when an individual encodes an event report that contains a retraction, the presence of event boundaries should impair retraction integration and memory updating, resulting in an enhanced CIE. Experiments 1 and 2 employed spatial event segmentation boundaries in an attempt to manipulate the ease with which a retraction can be integrated into a participant's mental event model. While Experiment 1 showed no impact of an event boundary, Experiment 2 yielded evidence that an event boundary resulted in a reduced CIE. To the extent that this finding reflects enhanced retrieval of the retraction relative to the misinformation, it is more in line with retrieval accounts of the CIE.

A general architecture for modeling the dynamics of goal-directed motivation and decision-making.

We present a unified model of the dynamics of goal-directed motivation and decision-making. The model-referred to as the GOAL architecture-provides a quantitative framework for integrating theories of goal pursuit and for relating their predictions to different types of data. The GOAL architecture proposes that motivation changes over time according to three gradients that capture the effects of the distance to the goal (i.e., the progress remaining), the time to the deadline, and the rate of progress required to achieve the goal. This enables the integration and comparison of six theoretical perspectives that make different predictions about how these dynamics unfold when pursuing approach and avoidance goals. Hierarchical Bayesian modeling was used to analyze data from three experiments which manipulate distance to goal, time to deadline, and goal type (approach vs. avoidance), and data from the naturalistic context of professional basketball. The results show that people rely on the distance and rate gradients, and to a lesser degree the time gradient, when making resource allocation decisions during goal pursuit, although the relative influence of the gradients depends on the goal type. We also demonstrate how the GOAL architecture can be used to answer questions about the influence of goal importance. Our findings suggest that goal pursuit unfolds in a complex manner that cannot be accounted for by any one previous theoretical perspective, but that is well-characterized by our unified framework. This research highlights the importance of theoretical integration for understanding motivation and decision-making during goal pursuit. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The influence of three-dimensional cues on body size judgements.

Research has shown that body size judgements are frequently biased, or inaccurate. Critically, judgement biases are further exaggerated for individuals with eating disorders, a finding that has been attributed to difficulties integrating body features into a perceptual whole. However, current understanding of which body features are integrated when judging body size is lacking. In this study, we examine whether individuals integrate three-dimensional (3D) cues to body volume when making body size judgements. Computer-generated body stimuli were presented in a 3D Virtual Reality environment. Participants (N = 412) were randomly assigned to one of the two conditions: in one condition, the to-be-judged body was displayed binocularly (containing 3D cues to body volume); in the other, bodies were presented monocularly (two-dimensional [2D] cues only). Across 150 trials, participants were required to make a body size judgement of a target female body from a third-person point of view using an unmarked visual analogue scale (VAS). It was found that 3D cues significantly influenced body size judgements. Namely, thin 3D bodies were judged smaller, and overweight 3D bodies were judged larger, than their 2D counterpart. Furthermore, to reconcile these effects, we present evidence that the two perceptual biases, regression to the mean and serial dependence, were reduced by the additional 3D feature information. Our findings increase our understanding of how body size is perceptually encoded and creates testable predictions for clinical populations exhibiting integration difficulties.

Sizing up the crowd: Assessing spatial integration difficulties in body size judgements across eating disorder symptomatology.

Introduction: Body size judgements are frequently biased, or inaccurate, and these errors are further exaggerated for individuals with eating disorders. Within the eating disorder literature, it has been suggested that exaggerated errors in body size judgements are due to difficulties with integration. Across two experiments, we developed a novel integration task, named the Ebbinghaus Illusion for Bodies in Virtual Reality (VR), to assess whether nearby bodies influence the perceived size of a single body. VR was used to simulate the appearance of a small crowd around a central target body. Method and Results: In Experiment 1 (N = 412), participants were required to judge the size of a central female target within a crowd. Experiment 1 revealed an Ebbinghaus Illusion, in which a central female appeared larger when surrounded by small distractors, but comparatively smaller when surrounded by large distractors. In other words, the findings of Experiment 1 demonstrate that surrounding crowd information is integrated when judging an individual's body size; a novel measure of spatial integration (i.e., an Ebbinghaus Illusion for Bodies in VR). In Experiment 2 (N = 96), female participants were selected based on high (n = 43) and low (n = 53) eating disorder symptomatology. We examined whether the magnitude of this illusion would differ amongst those with elevated versus low eating disorder symptomatology, in accordance with weak central coherence theory, with the high symptomatology group displaying less spatial integration relative to the low group. The results of Experiment 2 similarly found an Ebbinghaus Illusion for Bodies in VR. However, illusion magnitude did not vary across high and low symptomatology groups. Discussion: Overall, these findings demonstrate that surrounding crowd information is integrated when judging individual body size; however, those with elevated eating disorder symptomatology did not show any integration deficit on this broader measure of spatial integration.

Relations between timing, position, and grouping in short-term memory.

This article is concerned with how information about time and position in a sequence is represented in short-term memory and expressed in the dynamics of serial recall. Temporal-distinctiveness theories of memory predict that isolating a list item in time will improve recall accuracy for that item. Although the majority of research in short-term memory has failed to demonstrate a temporal isolation effect (TIE), there are occasions on which a TIE is observed. The disparity in results has been explained by assuming that participants can adaptively weight temporal and nontemporal information at retrieval, with differences between experiments promoting or discouraging reliance on time as a source of episodic information. A particular focus of the present study is the finding that the TIE is substantially observed in standard serial recall only when participants are instructed to group the list into minisequences. The findings of two experiments using instructed grouping replicated this effect but showed that it is attributable to a longer gap at the group boundary enhancing the positive effect of grouping on recall accuracy. These results show that the hierarchical representations usually associated with temporal grouping are also elicited by instructed grouping but that an additional and nonspecific benefit to recall obtains from lengthening the pause between groups. An additional role for time is identified in the timing of responses: The dynamics of input sequences tend to be mirrored in output sequences for ungrouped lists, whereas the primacy pattern in grouped lists is for a longer duration to speed access to the following group when that duration occurs at an instructed group boundary.