Developing a Multi-Dimensional Early Elementary Mathematics Screener and Diagnostic Tool: The Primary Mathematics Assessment.

There is a critical need to identify primary level students experiencing difficulties in mathematics to provide immediate and targeted instruction that remediates their deficits. However, most early math screening instruments focus only on the concept of number, resulting in inadequate and incomplete information for teachers to design intervention efforts. We propose a mathematics assessment that screens and provides diagnostic information in six domains that are important to building a strong foundation in mathematics. This article describes the conceptual framework and psychometric qualities of a web-based assessment tool, the Primary Math Assessment (PMA). The PMA includes a screener to identify students at risk for poor math outcomes and a diagnostic tool to provide a more in-depth profile of children's specific strengths and weaknesses in mathematics. The PMA allows teachers and school personnel to make better instructional decisions by providing more targeted analyses.

Generating keywords improves metacomprehension and self-regulation in elementary and middle school children.

The ability to monitor understanding of texts, usually referred to as metacomprehension accuracy, is typically quite poor in adult learners; however, recently interventions have been developed to improve accuracy. In two experiments, we evaluated whether generating delayed keywords prior to judging comprehension improved metacomprehension accuracy for children. For sixth and seventh graders, metacomprehension accuracy was greater when generating keywords. By contrast, for fourth graders, metacomprehension accuracy did not differ across conditions. Improved metacomprehension accuracy led to improved regulation of study. The delayed keyword effect in children reported here is discussed in terms of situation model activation.

Exploring metacognitive accuracy in visual search.

For decades, researchers have examined visual search. Much of this work has focused on the factors (e.g., movement, set size, luminance, distractor features and proximity) that influence search speed. However, no research has explored whether people are aware of the influence of these factors. For instance, increases in set size will typically slow down target detection; yet no research has measured participants' metacognitive awareness of this phenomenon. The present research explores this area by integrating a visual search task with a metacognitive monitoring paradigm. All of the explored factors influenced search latency. However, all of the factors except target presence influenced ratings. Saliency and suppression are discussed as two possible explanations for the results. Future directions for extending the theory and the practical benefits of this research are also outlined.

Test expectancy affects metacomprehension accuracy.

BACKGROUND: Theory suggests that the accuracy of metacognitive monitoring is affected by the cues used to judge learning. Researchers have improved monitoring accuracy by directing attention to more appropriate cues; however, this is the first study to more directly point students to more appropriate cues using instructions regarding tests and practice tests. AIMS: The purpose of the present study was to examine whether the accuracy metacognitive monitoring was affected by the nature of the test expected. SAMPLE AND METHOD: Students (N= 59) were randomly assigned to one of two test expectancy groups (memory vs. inference). Then after reading texts, judging learning, completed both memory and inference tests. RESULTS: Test performance and monitoring accuracy were superior when students received the kind of test they had been led to expect rather than the unexpected test. CONCLUSION: Tests influence students' perceptions of what constitutes learning. Our findings suggest that this could affect how students prepare for tests and how they monitoring their own learning.

The effects of comprehension-test expectancies on metacomprehension accuracy.

A set of four experiments assessed the effects of establishing a comprehension-test expectancy (in contrast to a memory-test expectancy) on relative metacomprehension accuracy. Typically readers show poor relative metacomprehension accuracy while learning from text (i.e., they are unable to discriminate topics they have understood well from topics they have understood poorly). In the first experiment, both readers who were given no test expectancy and those who were given a memory-test expectancy made judgments that were more predictive of performance on memory tests than inference tests. However, readers who were given a comprehension-test expectancy made judgments that were more predictive of inference-test performance. This effect was replicated and extended in two additional experiments that showed an effect of comprehension-test expectancy even when no example test items were provided, and when the expectancy was established only after reading. A fourth experiment showed that establishing a comprehension-test expectancy still had an effect on accuracy even when metacomprehension accuracy was already being improved via a self-explanation activity. The results show robust and reliable benefits to metacomprehension accuracy from a comprehension-test expectancy that serves as portable knowledge that learners can apply to monitoring future learning from text. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Why do delayed summaries improve metacomprehension accuracy?

We showed that metacomprehension accuracy improved when participants (N=87 college students) wrote summaries of texts prior to judging their comprehension; however, accuracy only improved when summaries were written after a delay, not when written immediately after reading. We evaluated two hypotheses proposed to account for this delayed-summarization effect (the accessibility hypothesis and the situation model hypothesis). The data suggest that participants based metacomprehension judgments more on the gist of texts when they generated summaries after a delay; whereas, they based judgments more on details when they generated summaries immediately after reading. Focusing on information relevant to the situation model of a text (the gist of a text) produced higher levels of metacomprehension accuracy, which is consistent with situation model hypothesis.

How restudy decisions affect overall comprehension for seventh-grade students.

BACKGROUND: Self-regulated learning requires accurate monitoring and effective regulation of study. Little is known about how effectively younger readers regulate their study. AIMS: We examined how decisions about which text to restudy affect overall comprehension for seventh-grade students. In addition to a Participant's Choice condition where students were allowed to pick texts for restudy on their own, we compared learning gains in two other conditions in which texts were selected for them. The Test-Based Restudy condition determined text selection using initial test performance - presenting the text with the lowest initial test performance for restudy, thereby circumventing potential problems associated with inaccurate monitoring and ineffective regulation. The Judgement-Based Restudy condition determined text selection using metacognitive judgements of comprehension - presenting the text with the lowest judgement of comprehension, thereby circumventing potential problems associated with ineffective regulation. SAMPLE: Four hundred and eighty seventh-grade students participated. METHOD: Students were randomly assigned to conditions in an experimental design. RESULTS AND CONCLUSIONS: Gains in comprehension following restudy were larger for the Test-Based Restudy condition than for the Judgement-Based Restudy condition or the Participant's Choice condition. No differences in comprehension were seen between the Judgement-Based Restudy and Participant's Choice conditions. These results suggest seventh graders can systematically use their monitoring to make decisions about what to restudy. However, the results highlight how inaccurate monitoring is one reason why younger students fail to benefit from self-regulated study opportunities.

Improving metacomprehension accuracy in an undergraduate course context.

Students tend to have poor metacomprehension when learning from text, meaning they are not able to distinguish between what they have understood well and what they have not. Although there are a good number of studies that have explored comprehension monitoring accuracy in laboratory experiments, fewer studies have explored this in authentic course contexts. This study investigated the effect of an instructional condition that encouraged comprehension-test-expectancy and self-explanation during study on metacomprehension accuracy in the context of an undergraduate course in research methods. Results indicated that when students received this instructional condition, relative metacomprehension accuracy was better than in a comparison condition. In addition, differences were also seen in absolute metacomprehension accuracy measures, strategic study behaviors, and learning outcomes. The results of the current study demonstrate that a condition that has improved relative metacomprehension accuracy in laboratory contexts may have value in real classroom contexts as well. (PsycINFO Database Record

Understanding the delayed-keyword effect on metacomprehension accuracy.

The typical finding from research on metacomprehension is that accuracy is quite low. However, recent studies have shown robust accuracy improvements when judgments follow certain generation tasks (summarizing or keyword listing) but only when these tasks are performed at a delay rather than immediately after reading (K. W. Thiede & M. C. M. Anderson, 2003; K. W. Thiede, M. C. M. Anderson, & D. Therriault, 2003). The delayed and immediate conditions in these studies confounded the delay between reading and generation tasks with other task lags, including the lag between multiple generation tasks and the lag between generation tasks and judgments. The first 2 experiments disentangle these confounded manipulations and provide clear evidence that the delay between reading and keyword generation is the only lag critical to improving metacomprehension accuracy. The 3rd and 4th experiments show that not all delayed tasks produce improvements and suggest that delayed generative tasks provide necessary diagnostic cues about comprehension for improving metacomprehension accuracy.

Individual differences, rereading, and self-explanation: concurrent processing and cue validity as constraints on metacomprehension accuracy.

The typical finding of metacomprehension studies is that accuracy in monitoring one's own level of understanding is quite poor. In the present experiments, monitoring accuracy was constrained by individual differences in both reading comprehension ability and working memory capacity (WMC), but rereading particularly benefited low-ability and low-WMC readers, effectively eliminating the relationship between monitoring accuracy and these reader characteristics. In addition, introducing a self-explanation reading strategy improved the accuracy of all the readers above mere rereading. The observed interaction between individual differences and rereading is interpreted in terms of concurrent-processing constraints involved in monitoring while text is processed, whereas the more general self-explanation effect is interpreted in terms of accessibility of valid, performance-predicting cues.

Causes and constraints of the shift-to-easier-materials effect in the control of study.

The shift-to-easier-materials (STEM) effect occurs when individuals adopt a low performance goal and subsequently select to restudy more easier items of a list than the difficult ones. The causes and constraints of the STEM effect were investigated across four experiments in which participants first briefly studied and judged their learning of 30 paired associates. They were then instructed to obtain a low performance goal and were asked to select items for restudy. The STEM effect was present when items were presented for selection simultaneously, but when items were presented for selection sequentially, the participants instead selected the more difficult items. The presence and absence of STEM effects were linked to planning that was triggered by the simultaneous format and to difficulties in executing an appropriate plan under the sequential format, respectively. Moreover, the STEM effect was evident for individuals with high memory spans but not for those with low memory spans. These and other findings highlight the contribution of planning and capacity constraints to the control of study time.