Tracking strategy changes using machine learning classifiers.

In complex tasks, high performers often have better strategies than low performers, even with similar amounts of practice. Relatively little research has examined how people form and change strategies in tasks that permit a large set of strategies. One challenge with such research is identifying strategies based on behavior. Three algorithms were developed that track the task features people use in their strategies while performing a complex task. Two of these algorithms were based on task-general, machine-learning classifiers: a support vector machine and a decision tree algorithm. The third was a task-specific algorithm. Data from several strategies in a complex task were simulated, and the algorithms were tested to see how well they identified the underlying features of the simulated strategy. The two machine-learning classifiers performed better than the task-specific algorithm. However, the two classifiers differed on how well they identified different types of strategies. The first two studies show that the ability of these algorithms to recover the underlying strategy depends on the complexity of the strategy relative to the quantity of performance data available. If the underlying strategy changes too frequently, then the performance of the algorithms suffers. However, results from the third study show that it is possible to use these algorithms to track strategy changes that occur in a task. The fourth study examines performance on data from human participants. This approach to tracking strategy exploration may enable further development of theories about how people search for and select effective strategies.

Mouse-tracking evidence for parallel anticipatory option evaluation.

In fast-paced, dynamic tasks, the ability to anticipate the future outcome of a sequence of events is crucial to quickly selecting an appropriate course of action among multiple alternative options. There are two classes of theories that describe how anticipation occurs. Serial theories assume options are generated and evaluated one at a time, in order of quality, whereas parallel theories assume simultaneous generation and evaluation. The present research examined the option evaluation process during a task designed to be analogous to prior anticipation tasks, but within the domain of narrative text comprehension. Prior research has relied on indirect, off-line measurement of the option evaluation process during anticipation tasks. Because the movement of the hand can provide a window into underlying cognitive processes, online metrics such as continuous mouse tracking provide more fine-grained measurements of cognitive processing as it occurs in real time. In this study, participants listened to three-sentence stories and predicted the protagonists' final action by moving a mouse toward one of three possible options. Each story was presented with either one (control condition) or two (distractor condition) plausible ending options. Results seem most consistent with a parallel option evaluation process because initial mouse trajectories deviated further from the best option in the distractor condition compared to the control condition. It is difficult to completely rule out all possible serial processing accounts, although the results do place constraints on the time frame in which a serial processing explanation must operate.

The neural correlates of strategic reading comprehension: cognitive control and discourse comprehension.

Neuroimaging studies of text comprehension conducted thus far have shed little light on the brain mechanisms underlying strategic learning from text. Thus, the present study was designed to answer the question of what brain areas are active during performance of complex reading strategies. Reading comprehension strategies are designed to improve a reader's comprehension of a text. For example, self-explanation is a complex reading strategy that enhances existing comprehension processes. It was hypothesized that reading strategies would involve areas of the brain that are normally involved in reading comprehension along with areas that are involved in strategic control processes because the readers are intentionally using a complex reading strategy. Subjects were asked to reread, paraphrase, and self-explain three different texts in a block design fMRI study. Activation was found in both executive control and comprehension areas, and furthermore, learning from text was associated with activation in the anterior prefrontal cortex (aPFC). The authors speculate that the aPFC may play a role in coordinating the internal and external modes of thought that are necessary for integrating new knowledge from texts with prior knowledge.

Assessing the transfer of interruption resumption skill to novel tasks.

Interruption interference refers to significant performance decreases that follow task interruption. Evidence has suggested that practicing interruption resumption reduces interruption interference as measured by the time required to resume the interrupted task. However, evidence has also indicated that interruption practice only improves resumption for the practiced pair of primary and interrupting tasks. If this is true, then there is little applied benefit in interruption training, because the training would be unlikely to transfer beyond the training environment. In the current studies, a transfer paradigm was utilized to determine whether interruption resumption skill practiced within a task-pair transfers to a novel task-pair. The results of Experiments 1A and 1B provide evidence that interruption resumption skill transfers to another primary task when the interrupting task is either held constant or varies. Experiment 2 manipulated the primary tasks to minimize the ability to reconstruct the next step in problem solving. When minimizing reconstruction, resumption skill that transfers is likely the ability to successfully retrieve the next planned action that was suspended when interrupted. The results support the conclusion that resumption skill does transfer and, therefore, opens up additional research avenues with applications to minimizing interruption interference. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The influence of open goals on the acquisition of problem-relevant information.

There have been a number of recent findings indicating that unsolved problems, or open goals more generally, influence cognition even when the current task has no relation to the task in which the goal was originally set. It was hypothesized that open goals would influence what information entered the problem-solving process. Three studies were conducted to establish the effect of open goals on the acquisition of problem-relevant information. It was found that problem-relevant information, or hints, presented implicitly in a 2nd task in between attempts at solving problems aided problem solving. This effect cannot be attributed to strategic behavior after participants caught on to the manipulation, as most participants were not aware of the relationship. The implications of this research are discussed, including potential contributions to our understanding of insight, incubation, transfer, and creativity.

The role of functionality in the mental representations of engineering students: some differences in the early stages of expertise.

As engineers gain experience and become experts in their domain, the structure and content of their knowledge changes. Two studies are presented that examine differences in knowledge representation among freshman and senior engineering students. The first study examines recall of mechanical devices and chunking of components, and the second examines whether seniors represent devices in a more abstract functional manner than do freshmen. The most prominent differences between these 2 groups involve their representation of the functioning of groups of electromechanical components and how these groups of components interact to produce device behavior. Seniors are better able to construct coherent representations of devices by focusing on the function of sets of components in the device. The findings from these studies highlight some ways in which the structure and content of mental representations of design knowledge differ during the early stages of expertise acquisition.

Comprehension through explanation as the interaction of the brain's coherence and cognitive control networks.

Discourse comprehension processes attempt to produce an elaborate and well-connected representation in the reader's mind. A common network of regions including the angular gyrus, posterior cingulate, and dorsal frontal cortex appears to be involved in constructing coherent representations in a variety of tasks including social cognition tasks, narrative comprehension, and expository text comprehension. Reading strategies that require the construction of explicit inferences are used in the present research to examine how this coherence network interacts with other brain regions. A psychophysiological interaction analysis was used to examine regions showing changed functional connectivity with this coherence network when participants were engaged in either a non-inferencing reading strategy, paraphrasing, or a strategy requiring coherence-building inferences, self-explanation. Results of the analysis show that the coherence network increases in functional connectivity with a cognitive control network that may be specialized for the manipulation of semantic representations and the construction of new relations among these representations.

The nature of mind wandering during reading varies with the cognitive control demands of the reading strategy.

Prior studies of mind wandering find the default network active during mind wandering, but these studies have yielded mixed results concerning the role of cognitive control brain regions during mind wandering. Mind wandering often interferes with reading comprehension, and prior neuroimaging studies of discourse comprehension and strategic reading comprehension have shown that there are at least two networks of brain regions that support strategic discourse comprehension: a domain-general control network and a network of regions supporting coherence-building comprehension processes. The present study was designed to further examine the neural correlates of mind wandering by examining mind wandering during strategic reading comprehension. Participants provided ratings of mind wandering frequency that were used to investigate interactions between the strategy being performed and brain regions whose activation was modulated by wind wandering. The results support prior findings showing that cognitive control regions are at times more active during mind wandering than during a task with low control demands, such as rereading. This result provides an initial examination of the neural correlates of mind wandering during discourse comprehension and shows that the processes being engaged by the primary task need to be considered when studying mind wandering. The results also replicate, in a different learning domain, prior findings of key brain areas associated with different reading strategies.

The effect of incidental hints when problems are suspended before, during, or after an impasse.

Two studies examine how the time at which problem solving is suspended relative to an impasse affects the impact of incidental hints. An impasse is a point in problem solving at which a problem solver is not making progress and does not know how to proceed. In both studies, work on remote associates problems was suspended before an impasse was reached, at the time an impasse was reached, or after a period of continued work during an impasse. After problem solving was suspended on a set of problems, participants completed a lexical decision task before resuming work on the set of unsolved problems. For half of the problems suspended during each impasse state, solution words were presented as incidental hints in the lexical decision task. The proportion of initially unsolved problems that were solved after the intervening lexical decision task was greater when problem solving was suspended at the point an impasse was reached than when problem solving was suspended before an impasse or after a period of continued work during an impasse. These results suggest that suspending problem solving at the point of impasse may increase susceptibility to incidentally presented hints. The point of impasse may be an opportune time for hints because the problem has been explored but there has not been a large increase in fixation on failed solution attempts.