The roles of phishing knowledge, cue utilization, and decision styles in phishing email detection.

This study investigated the roles of phishing knowledge, cue utilization, and decision styles in contributing to phishing email detection. Participants (N = 145) completed an online email sorting task, and measures of phishing knowledge, email decision styles, cue utilization, and email security awareness. Cue utilization was the only factor that uniquely predicted the capacity to discriminate phishing from genuine emails. Phishing knowledge was associated with greater phishing detection and a bias towards classifying all emails as phishing. A preference for intuitive decision making predicted lower detection of phishing emails, driven by a greater tendency to classify emails as genuine. These findings support the proposition that cue utilization is a distinct cognitive process that enables expert performance. The outcomes indicate that, in addition to increasing phishing knowledge and developing safe behavioral patterns, anti-phishing training needs to provide opportunities for trainees to develop meaningful cue associations.

Cue utilization and pool lifeguarding.

INTRODUCTION: Amongst pool lifeguards, the capacity to identify drowning swimmers quickly and accurately depends on the interpretation of critical cues. However, assessing the capacity for cue utilization amongst lifeguards at present is costly, time-consuming, and largely subjective. The aim of this study was to test the relationship between cue utilization and the detection of drowning swimmers in a series of virtual public swimming pool scenarios. METHOD: Eighty-seven participants with or without lifeguarding experience engaged in three virtual scenarios, two of which were target scenarios where drowning events occurred within a 13 minute or 23 minute period of watch. Cue utilization was assessed using the pool lifeguarding edition of the EXPERTise 2.0 software following which 23 participants were classified with higher cue utilization, while the remaining participants were classified with lower cue utilization. RESULTS: The results revealed that participants with higher cue utilization were more likely to have acquired experience as a lifeguard, were more likely to detect the drowning swimmer within a three minute period, and, in the case of the 13 minute scenario, recorded a greater dwell time on the drowning victim prior to the drowning event. CONCLUSION: The results suggest that cue utilization is associated with drowning detection performance in a simulated environment and could be employed as a basis for assessments of performance amongst lifeguards in the future. PRACTICAL IMPLICATIONS: Measures of cue utilization are associated with the timely detection of drowning victims in virtual pool lifeguarding scenarios. Employers and trainers of lifeguards can potentially augment existing lifeguarding assessment programs to quickly and cost-effectively identify the capabilities of lifeguards. This is especially useful for new lifeguards or where pool lifeguarding is a seasonal activity that might be associated with skill decay.

Cue utilisation is partially related to performance on an urban operations course but not experience.

INTRODUCTION: Decision making in use of force relies on accurate cue identification to inform appropriate response. This research was designed to test the relationship between cue utilisation and performance prior to, and following participation in an urban operations course (UOC). METHODS: A total of 37 participants were assessed on cue utilisation measures, course outcome and between group changes following course participation. RESULTS: A significant main effect was evident for Cue utilisation and administration, (p = 0.005), but not training group, (p = 0.54), nor between groups and point of administration, (p = 0.410). No main effect was evident between groups and training outcome, (p = 0.11). However, there was a main effect for point of administration, (p = 0.02) and training outcome and point of administration (p = 0.02). CONCLUSION: Although cue utilisation is an essential component of perception-action tasks, cues may be more specific to the relevant training environment with limited transfer to the operational context.

Virtual reality lifeguarding scenarios as a potential training solution for pool lifeguards.

BACKGROUND: Ensuring that pool lifeguards develop the skills necessary to detect drowning victims is challenging given that these situations are relatively rare, unpredictable and are difficult to simulate accurately and safely. Virtual reality potentially provides a safe and ecologically valid approach to training since it offers a near-to-real visual experience, together with the opportunity to practice task-related skills and receive feedback. As a prelude to the development of a training intervention, the aim of this research was to establish the construct validity of virtual reality drowning detection tasks. METHOD: Using a repeated measures design, a total of 38 qualified lifeguards and 33 non-lifeguards completed 13 min and 23 min simulated drowning detection tasks that were intended to reflect different levels of sustained attention. During the simulated tasks, participants were asked to monitor a virtual pool and identify any drowning targets with accuracy, response latency, and dwell time recorded. RESULTS: During the simulated scenarios, pool lifeguards detected drowning targets more frequently and spent less time than non-lifeguards fixating on the drowning target prior to the drowning onset. No significant differences in response latency were evident between lifeguards and non-lifeguards nor for first fixations on the drowning target. CONCLUSION: The results provide support for the construct validity of virtual reality lifeguarding scenarios, thereby providing the basis for their development and introduction as a potential training approach for developing and maintaining performance in lifeguarding and drowning detection. APPLICATION: This research provides support for the construct validity of virtual reality simulations as a potential training tool, enabling improvements in the fidelity of training solutions to improve pool lifeguard competency in drowning detection.

The role of cue utilization in the detection of phishing emails.

This study was designed to examine the roles of cue utilization, phishing features and time pressure in the detection of phishing emails. During two experiments, participants completed an email sorting task containing both phishing and genuine emails. Participants were allocated to either a high or low time pressure condition. Performance was assessed via detection sensitivity and response bias. Participants were classified with either higher or lower cue utilization and completed a measure of phishing knowledge. When participants were blind to the nature of the study (N = 191), participants with higher cue utilization were better able to discriminate phishing from genuine emails. However, they also recorded a stronger bias towards classifying emails as phishing, compared to participants with lower cue utilization. When notified of phishing base rates prior to the email sorting task (N = 191), participants with higher cue utilization were better able to discriminate phishing from genuine emails without recording an increase in rate of false alarms, compared to participants with lower cue utilization. Sensitivity increased with a reduction in time pressure, while response bias was influenced by the number of phishing-related features in each email. The outcomes support the proposition that cue-based processing of critical features is associated with an increase in the capacity of individuals to discriminate phishing from genuine emails, above and beyond phishing-related knowledge. From an applied perspective, these outcomes suggest that cue-based training may be beneficial for improving detection of phishing emails.

Are two-person checks more effective than one-person checks for safety critical tasks in high-consequence industries outside of healthcare? A systematic review.

Double-checking has been used in high-consequence industries for decades. We aimed to determine the strength of the evidence-base regarding the effectiveness of double-checking which underpins its widespread adoption. We searched for quantitative studies of the effectiveness of two-person checking in industry sectors, excluding healthcare. We performed a systematic literature search across six databases and hand-searched key journals. We completed a narrative synthesis and quality assessment of the nine studies identified. Most studies were of fair quality. Two examined the use of two-person checks in aviation, three investigated tasks in chemical manufacturing, and four studies in psychology involved proofreading and visual search tasks. All studies found that the performance of two-people checking was not superior to that of one-person in detecting errors. Further research to compare the effectiveness of different checking processes along with factors which may support optimisation of safety checks in high-consequence industries is required.

Explaining emergency physicians' capacity to recover from interruptions.

OBJECTIVE: To assess whether the capacity to utilize cues amongst emergency physicians is associated with differences in the capacity to recover performance following an interruption. BACKGROUND: Interruptions are implicated in errors in emergency medicine due to the cognitive load that they impose on working memory, resulting in a loss of performance on the primary task. The utilization of cues is associated with a reduction in cognitive load during the performance of a task, thereby enabling the allocation of residual resources that mitigates the loss of performance following interruptions. METHOD: Thirty-nine emergency physicians, recruited at a medical conference, completed an assessment of cue utilization (EXPERTise 2.0) and an online simulation (Septris) that involved the management of patients presenting with sepsis. During the simulation, physicians were interrupted and asked to check a medication order. Task performance was assessed using scores on Septris, with points awarded for the accurate management of patients. RESULTS: Emergency physicians with higher cue utilization recorded significantly higher scores on the simulation task following the interruption, compared to physicians with lower cue utilization (p = .028). CONCLUSION: The results confirm a relationship between cue utilization and the recovery of performance following an interruption. This is likely due to the advantages afforded by associated reductions in cognitive load. APPLICATION: Assessments of cue utilization may assist in the development of interventions to support clinicians in interruptive environments.

Negative Consequences of Pressure on Marksmanship May be Offset by Early Training Exposure to Contextually Relevant Threat Training: A Systematic Review and Meta-Analysis.

OBJECTIVE: The purpose of this meta-analytic review is to examine the relationship between increased psychological pressure and Use of Force (UOF) behaviours, identifying current training methodologies and effectiveness of transfer of training interventions in high threat-simulated scenarios. BACKGROUND: Data from UOF performance within Law Enforcement indicates a low transfer of marksmanship training into real-world UOF, resulting in unnecessary damage to property, personal injury and increased risk to loss of life. This meta-analysis examines both the impact of increased pressure and current training interventions. METHOD: A meta-analysis was conducted across a wide range of published research to answer the primary research questions. RESULTS: Increased levels of perceived pressure demonstrated an average decrease in marksmanship accuracy of 14.8%, together with a small increase in incorrect Decision Making (DM) and faster reaction Times (RT). Experience demonstrated a mitigating effect for pressure for marksmanship with a 1.1% increase for every one year of service but no effect on DM or RT. Training interventions utilizing a variety of early contextually relevant exposures to increased pressure improved performance over traditional training on average by 10.6%. CONCLUSION: The outcomes illustrate the negative effect of pressure on marksmanship and UOF behaviours, and that early exposure to contextually relevant pressure may increase the transfer of training to real-world performance. APPLICATION: Occupational experience is an important component in reducing the impact of pressure on UOF performance, and transfer of training may be enhanced through training methodologies that combine early exposure to contextually relevant pressure, that may replicate the benefits of experience.

The Role of Cue-Based Strategies in Skilled Diagnosis Among Pathologists.

OBJECTIVE: This research was designed to test whether behavioral indicators of pathology-related cue utilization were associated with performance on a diagnostic task. BACKGROUND: Across many domains, including pathology, successful diagnosis depends on pattern recognition that is supported by associations in memory in the form of cues. Previous studies have focused on the specific information or knowledge on which medical image expertise relies. The target in this study is the more general ability to identify and interpret relevant information. METHOD: Data were collected from 54 histopathologists in both conference and online settings. The participants completed a pathology edition of the Expert Intensive Skills Evaluation 2.0 (EXPERTise 2.0) to establish behavioral indicators of context-related cue utilization. They also completed a separate diagnostic task designed to examine related diagnostic skills. RESULTS: Behavioral indicators of higher or lower cue utilization were based on the participants' performance across five tasks. Accounting for the number of cases reported per year, higher cue utilization was associated with greater accuracy on the diagnostic task. A post hoc analysis suggested that higher cue utilization may be associated with a greater capacity to recognize low prevalence cases. CONCLUSION: This study provides support for the role of cue utilization in the development and maintenance of skilled diagnosis amongst pathologists. APPLICATION: Pathologist training needs to be structured to ensure that learners have the opportunity to form cue-based strategies and associations in memory, especially for less commonly seen diseases.

Differentiating Experience From Cue Utilization in Radiological Assessments.

OBJECTIVE: This research was designed to examine the contribution of self-reported experience and cue utilization to diagnostic accuracy in the context of radiology. BACKGROUND: Within radiology, it is unclear how task-related experience contributes to the acquisition of associations between features with events in memory, or cues, and how they contribute to diagnostic performance. METHOD: Data were collected from 18 trainees and 41 radiologists. The participants completed a radiology edition of the established cue utilization assessment tool EXPERTise 2.0, which provides a measure of cue utilization based on performance on a number of domain-specific tasks. The participants also completed a separate image interpretation task as an independent measure of diagnostic performance. RESULTS: Consistent with previous research, a k-means cluster analysis using the data from EXPERTise 2.0 delineated two groups, the pattern of centroids of which reflected higher and lower cue utilization. Controlling for years of experience, participants with higher cue utilization were more accurate on the image interpretation task compared to participants who demonstrated relatively lower cue utilization (p = .01). CONCLUSION: This study provides support for the role of cue utilization in assessments of radiology images among qualified radiologists. Importantly, it also demonstrates that cue utilization and self-reported years of experience as a radiologist make independent contributions to performance on the radiological diagnostic task. APPLICATION: Task-related experience, including training, needs to be structured to ensure that learners have the opportunity to acquire feature-event relationships and internalize these associations in the form of cues in memory.

Associations between double-checking and medication administration errors: a direct observational study of paediatric inpatients.

BACKGROUND: Double-checking the administration of medications has been standard practice in paediatric hospitals around the world for decades. While the practice is widespread, evidence of its effectiveness in reducing errors or harm is scarce. OBJECTIVES: To measure the association between double-checking, and the occurrence and potential severity of medication administration errors (MAEs); check duration; and factors associated with double-checking adherence. METHODS: Direct observational study of 298 nurses, administering 5140 medication doses to 1523 patients, across nine wards, in a paediatric hospital. Independent observers recorded details of administrations and double-checking (independent; primed-one nurse shares information which may influence the checking nurse; incomplete; or none) in real time during weekdays and weekends between 07:00 and 22:00. Observational medication data were compared with patients' medical records by a reviewer (blinded to checking-status), to identify MAEs. MAEs were rated for potential severity. Observations included administrations where double-checking was mandated, or optional. Multivariable regression examined the association between double-checking, MAEs and potential severity; and factors associated with policy adherence. RESULTS: For 3563 administrations double-checking was mandated. Of these, 36 (1·0%) received independent double-checks, 3296 (92·5%) primed and 231 (6·5%) no/incomplete double-checks. For 1577 administrations double-checking was not mandatory, but in 26·3% (n=416) nurses chose to double-check. Where double-checking was mandated there was no significant association between double-checking and MAEs (OR 0·89 (0·65-1·21); p=0·44), or potential MAE severity (OR 0·86 (0·65-1·15); p=0·31). Where double-checking was not mandated, but performed, MAEs were less likely to occur (OR 0·71 (0·54-0·95); p=0·02) and had lower potential severity (OR 0·75 (0·57-0·99); p=0·04). Each double-check took an average of 6·4 min (107 hours/1000 administrations). CONCLUSIONS: Compliance with mandated double-checking was very high, but rarely independent. Primed double-checking was highly prevalent but compared with single-checking conferred no benefit in terms of reduced errors or severity. Our findings raise questions about if, when and how double-checking policies deliver safety benefits and warrant the considerable resource investments required in modern clinical settings.

Drivers' Cue Utilization Predicts Cognitive Resource Consumption During a Simulated Driving Scenario.

OBJECTIVE: This study was designed to examine whether cue utilization differentiates drivers' consumption of cognitive resources during a simulated driving task. BACKGROUND: Outcomes from previous research have demonstrated that a general capacity for cue utilization differentiates cognitive load during novel process control tasks. However, it was previously unclear whether similar results would be demonstrated during familiar operational tasks. METHOD: Based on an assessment of cue utilization within a driving context, participants were classified into higher or lower cue utilization typologies. During a simulated driving task, cognitive load was assessed through changes against baseline in cerebral oxygenation in the prefrontal cortex, through eye behavior metrics (fixation rates and fixation dispersion), and through driving performance (frequency of missed traffic signals and speed exceedances). RESULTS: Drivers with higher cue utilization recorded smaller mean fixation dispersions, smaller increases in cerebral oxygenation, and fewer missed traffic signals compared with drivers with lower cue utilization. These results suggest that compared with drivers with lower cue utilization, drivers with higher cue utilization experienced lower cognitive load during the simulated driving task while maintaining a higher level of performance. CONCLUSION: The results provide support for the assertion that, among qualified operators, a greater capacity for cue utilization is associated with lower cognitive load during operational tasks. APPLICATION: Cue-based assessments of driving may be beneficial in predicting performance and assisting in targeted training for recently qualified and/or older drivers.

The development and validation of a short-duration sustained visual search task for process control environments.

This study was designed to validate a short-duration sustained visual search task for the assessment of sustained attention in process control environments. The task consists of 10 short dynamic scenarios, which require participants (N = 121) to monitor simulated operating power transmission interfaces, and identify system faults. A vigilance decrement was demonstrated throughout the sustained visual search task, as evident in increased response latencies and decreased accuracy over time. Further, changes in response latency throughout the sustained visual search task were positively associated with changes in response latency during a 30-min, low signal probability task, a 45-min low signal probability task, and a 45-min high signal probability task. The findings indicate that the sustained visual search task may be a valid alternative to a longer-duration process control task for experimental studies, and is likely to be of value for assessments of the capacity for sustained attention of operators in process control environments.

Cross-task cue utilisation and situational awareness in learning to manage a simulated rail control task.

Cue utilisation and situational awareness share similar properties since both constructs are dependent upon the application of feature-event associations in memory. The aim of this study was to investigate the extent to which cue utilisation and situational awareness contribute to learning a simplified, simulated rail control task incorporating an implicit pattern of train movements. Fifty-five undergraduate students completed an assessment of cue utilisation prior to completing the rail control task during periods of lower and higher task demands. Situational awareness was assessed using Situation Awareness Global Assessment Technique (SAGAT) queries. The results indicated that, while both cue utilisation and situational awareness were related to the detection of the implicit pattern of train movements, they contributed separately to performance on the simulated rail control task. The outcomes suggest that cue utilisation and situational awareness may be separate constructs, where cue utilisation constitutes a capacity variable that is associated with changes in response to task demand and situational awareness constitutes an outcome variable that emerges through task exposure.

The Role of Cue Utilization and Cognitive Load in the Recognition of Phishing Emails.

Phishing emails represent a major threat to online information security. While the prevailing research is focused on users' susceptibility, few studies have considered the decision-making strategies that account for skilled detection. One relevant facet of decision-making is cue utilization, where users retrieve feature-event associations stored in long-term memory. High degrees of cue utilization help reduce the demands placed on working memory (i.e., cognitive load), and invariably improve decision performance (i.e., the information-reduction hypothesis in expert performance). The current study explored the effect of cue utilization and cognitive load when detecting phishing emails. A total of 50 undergraduate students completed: (1) a rail control task; (2) a phishing detection task; and (3) a survey of the cues used in detection. A cue utilization assessment battery (EXPERTise 2.0) then classified participants with either higher or lower cue utilization. As expected, higher cue utilization was associated with a greater likelihood of detecting phishing emails. However, variation in cognitive load had no effect on phishing detection, nor was there an interaction between cue utilization and cognitive load. Further, the findings revealed no significant difference in the types of cues used across cue utilization groups or performance levels. These findings have implications for our understanding of cognitive mechanisms that underpin the detection of phishing emails and the role of factors beyond the information-reduction hypothesis.

Cue utilisation predicts control room operators' performance in a sustained visual search task.

This research was designed to determine whether qualified practitioners' cue utilisation is predictive of their performance during a sustained visual search task in an operational context. Australian Distribution Network Service Provider (DNSP) operators were recruited for two experiments, and were classified with either higher or lower cue utilisation based on an assessment of cue utilisation within the context of power distribution. Operators' performance was assessed using a domain-related sustained visual search task. In both experiments, power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, compared to operators with lower cue utilisation. Further, no differences in accuracy based on cue utilisation were observed during the sustained visual search task. The results are consistent with the proposition that power operators with higher cue utilisation have a greater capacity to sustain visual search during domain-related tasks, compared to operators with lower cue utilisation. Practitioner summary: Power distribution system operators' cue utilisation was used to predict performance during a domain-related sustained visual search task. Power distribution operators with higher cue utilisation demonstrated shorter mean response latencies during the sustained visual search task, but no differences in accuracy, compared to operators with lower cue utilisation. Abbreviations: DNSP: distribution network service provider; EXPERTise 2.0: EXPERT intensive skills evaluation; FAT: feature association task; FDT: feature discrimination task; FIT: feature identification task; fNIRS: functional near infrared spectroscopy; FPT: feature prioritisation task; FRT: feature recognition task; SCADA: supervisory control and data acquisition.

Cue Utilization Differentiates Performance in the Management of Interruptions.

OBJECTIVE: To examine the role of cue utilization in the management of interruptions during a high workload, rail control simulation. BACKGROUND: High-risk, high-consequence environments are characterized by cognitively demanding, time-critical activities, in which operators are required to manage frequent interruptions under conditions of high workload. Interruptions are deleterious to performance as they impose excessive cognitive demand on limited working memory resources, thereby depleting residual resources for the primary task. Cue utilization may enable superior performance in managing interruptions through efficiencies gained by the application of implicit patterns stored in long-term memory. METHOD: Two experiments were conducted. In Experiment 1, 46 university students undertook an assessment of cue utilization and subsequently engaged in a high workload, simulated rail control task while managing multiple interruptive tasks. Experiment 2 replicated and extended Experiment 1, wherein 52 university students completed a measure of cue utilization and engaged in a high workload, simulated rail control task while managing multiple interruptions and breaks. RESULTS: The analyses revealed that participants who demonstrated a greater capacity for cue utilization also demonstrated a reduced loss of performance following interruptions. CONCLUSION: The outcomes suggest a relationship between a greater capacity for cue utilization and superior performance in the management of interruptions in high workload conditions. APPLICATION: Assessments of cue utilization may assist in the selection and training of operators in high-consequence, high-risk environments, to ensure efficient and accurate performance during the management of interruptions.

Higher social cue utilisation improves communication, reduces perceived workload, and improves performance amongst ad hoc dyads in simulated rail control.

The objective was to examine whether ad hoc dyads with different collective social cue utilisation would record differences in performance and perceptions of workload during a simulated rail control task that incorporated distinct levels of demand. The frequency of two types of communicative statements was also examined as mediating factors: closing the loop and informative responding. A quasi-experimental design was employed using 40 dyadic teams. The results indicated that ad hoc teams whose members comprised higher social cue utilisation recorded relatively faster response times and perceived lower levels of workload, and engaged in a greater frequency of communicative statements that involved 'closing the loop' and 'informative responses'. Social cue utilisation also exerted an indirect effect on perceived workload through informative responding. The outcomes have theoretical implications for models of ad hoc team performance, and practical implications for the selection and training of teams that operate on an ad hoc basis. Practitioner summary: This study indicates that, in the context of simulation tasks requiring teamwork, higher social cue utilisation amongst ad hoc team members is associated with communication, workload perception, and overall performance.

Higher cue utilization in driving supports improved driving performance and more effective visual search behaviors.

INTRODUCTION: Once qualified, drivers rarely receive objective feedback concerning their performance. This is especially the case in the context of cognitive skills such as situation assessment. The aim of this study was to test the construct validity of an online assessment of motor-vehicle driver cue utilization that forms the foundation for situation assessment. METHOD: Seventy-one undergraduate Psychology students with broadly comparable driving experience completed a motor-vehicle driving version of EXPERTise 2.0, an online tool that enables inferences concerning the utilization of cues based on responses to task-related stimuli. They also completed a simulated driving task while fitted with an eye tracking device, during which a range of hazards were presented with participants' responses recorded. RESULTS: The results indicated that higher cue utilization was associated with fewer driving errors and collisions, fewer visual fixations, and fewer saccades in comparison to participants with lower cue utilization. CONCLUSION: The results provide support for the construct validity of EXPERTise 2.0 as an effective measure of cue utilization in the context of driving. PRACTICAL APPLICATIONS: Providing comparative feedback to drivers concerning their development of situation assessment skills may provide opportunities for further training and development, thereby reducing the likelihood of motor-vehicle accidents.

Control Room Operators' Cue Utilization Predicts Cognitive Resource Consumption During Regular Operational Tasks.

This study was designed to examine whether qualified practitioners' cue utilization is predictive of their sustained attention performance during regular operational tasks. Simulated laboratory studies have demonstrated that cue utilization differentiates cognitive load during process control tasks. However, it was previously unclear whether similar results would be demonstrated with qualified practitioners during familiar operational tasks. Australian distribution network service provider (DNSP) operators were classified with either higher or lower cue utilization based on an assessment of cue utilization within the context of electrical power distribution. During two, 20-min periods of operators' regular workdays, physiological measures of workload were assessed through changes in cerebral oxygenation in the prefrontal cortex compared to baseline, and through eye behavior metrics (fixation rates, saccade amplitude, and fixation dispersion). The results indicated that there were no statistically significant differences in eye behavior metrics, based on levels of cue utilization. However, as hypothesized, during both sessions, operators with higher cue utilization demonstrated smaller increases in cerebral oxygenation in the prefrontal cortex from baseline, compared to operators with lower cue utilization. The results are consistent with the proposition that operators with higher cue utilization experience lower cognitive load during periods of regular activity during their workday, compared to operators with lower cue utilization. Assessments of cue utilization could help identify operators who are better able to sustain attention during regular operational tasks, as well as those who may benefit from cue-based training interventions.