What makes domain knowledge difficult? Word usage frequency from SUBTLEX and dlexDB explains knowledge item difficulty.

The quality of tests in psychological and educational assessment is of great scholarly and public interest. Item difficulty models are vital to generating test result interpretations based on evidence. A major determining factor of item difficulty in knowledge tests is the opportunity to learn about the facts and concepts in question. Knowledge is mainly conveyed through language. Exposure to language associated with facts and concepts might be an indicator of the opportunity to learn. Thus, we hypothesize that item difficulty in knowledge tests should be related to the probability of exposure to the item content in everyday life and/or academic settings and therefore also to word frequency. Results from a study with 99 political knowledge test items administered to N = 250 German seventh (age: 11-14 years) and tenth (age: 15-18 years) graders showed that word frequencies in everyday settings (SUBTLEX-DE) explain variance in item difficulty, while word frequencies in academic settings (dlexDB) alone do not. However, both types of word frequency combined explain a considerable amount of the variance in item difficulty. Items with words that are more frequent in both settings and, in particular, relatively frequent in everyday settings are easier. High word frequencies and relatively higher word frequency in everyday settings could be associated with higher probability of exposure, conceptual complexity, and better readability of item content. Examining word frequency from different language settings can help researchers investigate test score interpretations and is a useful tool for predicting item difficulty and refining knowledge test items.

COVID-19 Pandemic and Student Reading Achievement: Findings From a School Panel Study.

Since 2020, the COVID-19 pandemic had an impact on education worldwide. There is increased discussion of possible negative effects on students' learning outcomes and the need for targeted support. We examined fourth graders' reading achievement based on a school panel study, representative on the student level, with N = 111 elementary schools in Germany (total: N = 4,290 students, age: 9-10 years). The students were tested with the Progress in International Reading Literacy Study instruments in 2016 and 2021. The analysis focused on (1) total average differences in reading achievement between 2016 and 2021, (2) average differences controlling for student composition, and (3) changes in achievement gaps between student subgroups (i.e., immigration background, socio-cultural capital, and gender). The methodological approach met international standards for the analysis of large-scale assessments (i.e., multiple multi-level imputation, plausible values, and clustered mixed-effect regression). The results showed a substantial decline in mean reading achievement. The decline corresponds to one-third of a year of learning, even after controlling for changes in student composition. We found no statistically significant changes of achievement gaps between student subgroups, despite numerical tendencies toward a widening of achievement gaps between students with and without immigration background. It is likely that this sharp achievement decline was related to the COVID-19 pandemic. The findings are discussed in terms of further research needs, practical implications for educating current student cohorts, and educational policy decisions regarding actions in crises such as the COVID-19 pandemic.

Civic Education, Teaching Quality and Students' Willingness to Participate in Political and Civic Life: Political Interest and Knowledge as Mediators.

Civic education is generally assumed to play a key role in youth's political sophistication. It aims to equip young people with the necessary competencies and skills to effectively participate in political and civic life. However, few studies have examined the relative importance of different facets of teaching quality within civic education as well as mediating factors for fostering active citizens. The present study seeks to fill this gap by investigating how different facets of teaching quality are associated with adolescents' willingness to participate in political and civic life and how this relationship is mediated by political knowledge and interest. The study uses original data from N = 250 students (n = 152 7th graders: Mage = 12.54, SD = 0.91, range = 11-14, 45% female; n = 98 10th graders: Mage = 16.12, SD = 0.97, range = 15-18, 35% female). The findings show that not all teaching quality facets are equally important. While perceived cognitive activation and open classroom climate were positively associated with students' willingness to participate, a statistically significant association with discussions of current political events in the classroom was not found. In addition, the relationship between perceived cognitive activation and willingness to participate is fully mediated by students' political knowledge and interest. This study illustrates the relative importance of different teaching quality facets in civic education and calls for continued efforts to better understand teaching quality in civic education.

Influences of basic numerical abilities on graph reading performance.

Understanding graphically presented information is an important aspect of modern mathematical and science literacy. In our study, we investigated the influence of basic numerical abilities on students' ability answer mathematical tasks with information presented in graphs. We analyzed data of 750 German students (grades 9-11) and evaluated the determinants of graph reading performance with multiple regression analysis using predictors of basic numerical abilities (such as number line estimation, basic arithmetic operations, etc.), considering also the influences of general cognitive ability, age, and gender. We found that number line estimation, subtraction, and conceptual knowledge were significant predictors of graph reading performance beyond the influences of general cognitive ability. This indicates that basic numerical abilities are still relevant for real-life problem solving in secondary school. We discuss possible mechanisms which directly (through respective arithmetic procedures) as well as indirectly (through mathematization of the problem) effectuate that basic numerical abilities graph reading performance.