Unpacking on-task effort in performance-based learning: Information-knowledge gaps guide effort allocation decisions.

Learning and adaptation are essential for success. However, human effort is inherently finite, which creates a dilemma for employees. Is it better to prioritize capitalizing on existing knowledge structures to maximize immediate performance benefits (exploitation) or develop adaptive capabilities (exploration) at the expense of short-term productivity? Understanding how employees answer this question can inform the design of evidence-based interventions for optimizing and sustaining learning amidst workplace challenges. In this article, we attempt to unpack the composition of on-task effort during performance-based learning by testing the proposition that the information-knowledge gap-a regulatory discrepancy between unknown aspects of a task and a person's perceived competence in dealing with that task-is the psychological mechanism responsible for guiding effort-allocation decisions during performance-based learning. In Study 1, we found that larger information-knowledge gaps resulted in increased subsequent investments of on-task attention within a sample of adults learning to perform a complex task (N = 121). As participants learned, information-knowledge gaps systematically shrank, resulting in a reduced emphasis on learning-oriented effort (i.e., exploration) relative to achievement-oriented effort (i.e., exploitation) over time. In Study 2 (N = 176), a task-change paradigm revealed that introducing novel demands caused information-knowledge gaps to suddenly expand, which prompted participants to increase on-task effort and shift their focus away from achievement and back toward learning as an adaptive response. Collectively, these findings support the notion that information-knowledge gaps shape how (and when) on-task effort is spent and present a framework for understanding how learners strategically structure their limited attentional resources. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Keeping Calm and Carrying On: Relating Affect Spin and Pulse to Complex Skill Acquisition and Adaptive Performance.

The purpose of this laboratory study involving repeated measures of emotion as 214 undergraduates (58.4% male) learned a complex video game was to address the need for empirical research on dynamic personality constructs by examining how two aspects of affect variability-spin and pulse-explain variance in skill acquisition and adaptive performance. Spin refers to within-person fluctuations in affect pleasantness and activation potential. Pulse refers to within-person fluctuations in affect intensity. Despite research showing high affect variability reflects a personality profile of heighted reactivity to emotionally charged events and poor adjustment, little empirical research has examined their relationships with behavioral outcomes, much less aspects of skilled performance. Compared to traditional measures of personality, which yield weak effects for predicting acquisition and adaptive performance, measures of affect variability hold considerable promise because they, like performance, reflect dynamic within-person phenomena. Accordingly, the main question addressed by this study was whether spin and pulse incrementally explain acquisition and adaptive performance beyond Big Five measures of personality. In general, we expected harmful, incremental effects for both spin and pulse, and hypothesized two mechanisms for these harmful effects: (1) by undermining effort and (2) by undermining the effort-performance relationship. Using a task-change paradigm and discontinuous growth modeling that disentangled adaptation from acquisition, results showed that affect variability, independent of the Big Five, produced harmful effects via both hypothesized mechanisms. Participants higher in affect spin and pulse showed less sustained effort across performance sessions and exhibited lower performance. Furthermore, the harmful effects of spin and pulse were stronger in adaptation compared to acquisition, with pulse showing stronger direct effects on performance during adaptation and spin moderating the effort-performance relationship such that effort was only beneficial during adaptation for those lower in spin. In light of these results, one might question the common advice "keep calm and carry on," which may not be viable for persons high in affect variability. Accordingly, results are discussed in terms of the need to better understand the specific mediating processes by which high affect variability undermines success across a variety of learning and performance contexts.

Relating indices of knowledge structure coherence and accuracy to skill-based performance: Is there utility in using a combination of indices?

The authors examined the relative criterion-related validity of knowledge structure coherence and two accuracy-based indices (closeness and correlation) as well as the utility of using a combination of knowledge structure indices in the prediction of skill acquisition and transfer. Findings from an aggregation of 5 independent samples (N = 958) whose participants underwent training on a complex computer simulation indicated that coherence and the accuracy-based indices yielded comparable zero-order predictive validities. Support for the incremental validity of using a combination of indices was mixed; the most, albeit small, gain came in pairing coherence and closeness when predicting transfer. After controlling for baseline skill, general mental ability, and declarative knowledge, only coherence explained a statistically significant amount of unique variance in transfer. Overall, the results suggested that the different indices largely overlap in their representation of knowledge organization, but that coherence better reflects adaptable aspects of knowledge organization important to skill transfer.

The difference isn't black and white: stereotype threat and the race gap on Raven's Advanced Progressive Matrices.

This study addresses recent criticisms aimed at the interpretation of stereotype threat research and methodological weaknesses of previous studies that have examined race differences on Raven's Advanced Progressive Matrices (APM). African American and White undergraduates completed the APM under three conditions. In two threat conditions, participants received either standard APM instructions (standard threat) or were told that the APM was an IQ test (high threat). In a low threat condition, participants were told that the APM was a set of puzzles and that the researchers wanted their opinions of them. Results supported the stereotype threat interpretation of race differences in cognitive ability test scores. Although African American participants underperformed Whites under both standard and high threat instructions, they performed just as well as Whites did under low threat instructions.

Large-scale investigation of the role of trait activation theory for understanding assessment center convergent and discriminant validity.

This study used trait activation theory as a theoretical framework to conduct a large-scale test of the interactionist explanation of the convergent and discriminant validity findings obtained in assessment centers. Trait activation theory specifies the conditions in which cross-situationally consistent and inconsistent candidate performances are likely to occur. Results obtained by aggregating correlations across 30 multitrait-multimethod matrices supported the propositions of trait activation theory, shedding a more positive light on the construct validity puzzle in assessment centers. Overall, convergence among assessment center ratings was better between exercises that provided an opportunity to observe behavior related to the same trait, and discrimination among ratings within exercises was generally better for dimensions that were not expressions of the same underlying traits. Implications for assessment center research and practice are discussed.

Relationships among team ability composition, team mental models, and team performance.

This study examined the relationship between the similarity and accuracy of team mental models and compared the extent to which each predicted team performance. The relationship between team ability composition and team mental models was also investigated. Eighty-three dyadic teams worked on a complex skill task in a 2-week training protocol. Results indicated that although similarity and accuracy of team mental models were significantly related, accuracy was a stronger predictor of team performance. In addition, team ability was more strongly related to the accuracy than to the similarity of team mental models and accuracy partially mediated the relationship between team ability and team performance, but similarity did not.

A multilevel approach to relating subjective workload to performance after shifts in task demand.

OBJECTIVE: The aim of this laboratory experiment was to demonstrate how taking a longitudinal, multilevel approach can be used to examine the dynamic relationship between subjective workload and performance over a given period of activity involving shifts in task demand. BACKGROUND: Subjective workload and conditions of the performance environment are oftentimes examined via cross-sectional designs without distinguishing within-from between-person effects. Given the dynamic nature of performance phenomena, multilevel designs coupled with manipulations of task demand shifts are needed to better model the dynamic relationships between state and trait components of subjective workload and performance. METHOD: With a sample of 75 college students and a computer game representing a complex decision-making environment, increases and decreases in task demand were counterbalanced and subjective workload and performance were measured concurrently in regular intervals within performance episodes. Data were analyzed using hierarchical linear modeling. RESULTS: Both between- and especially within-person effects were dynamic. Nevertheless, at both levels of analysis, higher subjective workload reflected performance problems, especially more downstream from increases in task demand. CONCLUSION: As a function of cognitive-energetic processes, shifts in task demand are associated with changes in how subjective workload is related to performance over a given period of activity. Multilevel, longitudinal approaches are useful for distinguishing and examining the dynamic relationships between state and trait components of subjective workload and performance. APPLICATION: The findings of this research help to improve the understanding of how a sequence of demands can exceed a performer's capability to respond to further demands.

Learner-controlled practice difficulty in the training of a complex task: cognitive and motivational mechanisms.

An inherent aspect of learner-controlled instructional environments is the ability of learners to affect the degree of difficulty faced during training. However, research has yet to examine how learner-controlled practice difficulty affects learning. Based on the notion of desirable difficulties (Bjork, 1994), this study examined the cognitive and motivational antecedents and outcomes of learner-controlled practice difficulty in relation to learning a complex task. Using a complex videogame involving both strong cognitive and psychomotor demands, 112 young adult males were given control over their practice difficulty, which was reflected in the complexity of the training task. Results show that general mental ability, prior experience, pre-training self-efficacy, and error encouragement were positively related to learner-controlled practice difficulty. In turn, practice difficulty was directly related to task knowledge and post-training performance, and it was related to adaptive performance through the mediating influences of task knowledge and post-training performance. In general, this study supports the notion that training difficulty operationalized in terms of task complexity is positively related to both knowledge and performance outcomes. Results are discussed with respect to the need for more research examining how task complexity and other forms of difficulty could be leveraged to advance learner-controlled instructional practices.

Collaborative training with a more experienced partner: remediating low pretraining self-efficacy in complex skill acquisition.

OBJECTIVE: This study examined the effectiveness of collaborative training for individuals with low pretraining self-efficacy versus individuals with high pretraining self-efficacy regarding the acquisition of a complex skill that involved strong cognitive and psychomotor demands. BACKGROUND: Despite support for collaborative learning from the educational literature and the similarities between collaborative learning and interventions designed to remediate low self-efficacy, no research has addressed how self-efficacy and collaborative learning interact in contexts concerning complex skills and human-machine interactions. METHOD: One hundred fifty-five young male adults trained either individually or collaboratively with a more experienced partner on a complex computer task that simulated the demands of a dynamic aviation environment. Participants also completed a task-specific measure of self-efficacy before, during, and after training. RESULTS: Collaborative training enhanced skill acquisition significantly more for individuals with low pretraining self-efficacy than for individuals with high pretraining self-efficacy. However, collaborative training did not bring the skill acquisition levels of those persons with low pretraining self-efficacy to the levels found for persons with high pretraining self-efficacy. Moreover, tests of mediation suggested that collaborative training may have enhanced appropriate skill development strategies without actually raising self-efficacy. CONCLUSION: Although collaborative training can facilitate the skill acquisition process for trainees with low self-efficacy, future research is needed that examines how the negative effects of low pretraining self-efficacy on complex skill acquisition can be more fully remediated. APPLICATION: The differential effects of collaborative training as a function of self-efficacy highlight the importance of person analysis and tailoring training to meet differing trainee needs.

Convergence of self-report and archival crash involvement data: a two-year longitudinal follow-up.

This study constructively extends Arthur et al. (2001) by assessing the convergence of self-report and archival motor vehicle crash involvement and moving violations data in a 2-year longitudinal follow-up. The relationships among these criteria, conscientiousness, and driving speed were also assessed using both predictive and postdictive criterion-related validation designs. Data were collected from a 2-year follow-up sample of 334 participants. Results suggested a lack of convergence between self-report and archival data at both Time 1 and Time 2. In addition, the predictor/criterion relationships varied across research design and data source. An actual application of our findings is that the interpretation of relationships between specified predictors and crash involvement and moving violations must be made within the context of the criterion-related validation design and criterion data source. Specifically, predictive designs may produce results different from those of postdictive designs (which are more commonly used). Furthermore, self-report data appear to include a broader range of incidents (more crashes and tickets), and thus researchers should consider using self-report data when they are interested in including lower threshold crashes and tickets that may not be reported on state records (e.g., because of the completion of a defensive driving course).