Exploring Indonesian student misconceptions in science concepts.

This study aims to investigate the development and the differences in student misconceptions in science based on gender and grade level, and to evaluate the developed two-tier multiple-choice diagnostic test in confirming the test's validity and reliability. A sample of 856 participants from 10th-12th graders and prospective science teachers were collected. The two-tier multiple-choice diagnostic test with 32 items covering biology, chemistry, and physics was administered to evaluate students' science misconceptions at the senior high school and university levels. The results met validity and reliability criteria using confirmatory factor analysis and Rasch parameters. The single-factor model has CFI = .973, RMSEA = .006, CI (.001, .014) and SRMR = .017 and the three-factor model has CFI = 0.939, RMSEA = .010, CI (.01, .017) and SRMR = .017. Based on the Rasch parameter, the infit and outfit MNSQ values achieve the acceptable fit (0.96 to 1) with good item reliability (.99) and person reliability (.80). All items have positive PTMA. Student misconceptions had significant differences in terms of grade and gender. We confirmed that prospective science teachers have higher misconceptions than 11th and 12th graders and slightly higher ones than 10th graders. Boys have a better conceptual understanding than girls based on the mean of correct answers. The multiple linear regression with the stepwise method confirmed that gender significantly predicted student misconceptions of science concepts, with 9% of variance explained. This study provided evidence that students and prospective teachers experience various misconceptions about science concepts.

A study of reading attitude and reading achievement among young learners in middle school.

This study examines the relation between reading attitude and reading achievement in three languages among sixth- and eighth-grade students in Kazakhstan. Participants were randomly chosen from seven secondary schools in a major city. Their native languages were Kazakh or Russian (N = 1,505). Reading tests in English, Kazakh and Russian and a reading attitude questionnaire were administered via the eDia online assessment system. The results indicate that 85% of the sixth graders and 79% of the eighth graders enjoy reading. Correlations in reading achievement between English, Kazakh and Russian ranged from r = .55 to r = .61 (p < .01). Kazakh native speakers performed better in the respective languages than speakers of Russian and other languages. A factor analysis demonstrated a three-factor model for Grade 6 and a four-factor model for Grade 8, corresponding to reading attitude and reliability coefficients for these factors from .71 to .86. In both grades, factor loading showed a good fit to the data. Regression analysis showed a weak relation between reading attitude and reading achievement among sixth and eighth graders in the targeted languages despite a positive attitude towards reading.

Computer-Based Development of Reading Skills to Reduce Dropout in Uncertain Times.

An adequate level of reading comprehension is a prerequisite for successful learning. Numerous studies have shown that without a solid foundation, there can be severe difficulties in later learning and that failure in the first years of schooling can determine attitudes to learning. In the present study, we present the effect size of an online game-based training program implemented on eDia. The primary goals of the development program are to develop fluency in reading and reading comprehension in Grades 3−4. The content of the program has been developed in accordance with the national core curriculum and the textbooks based on it. Therefore, it can be integrated into both classroom-based lessons and extracurricular activities outside of class. The quasiexperimental research involved 276 students. Propensity score matching was used in examining the effect size of the development program to increase the validity of the results. Through the training program, the development of students in the intervention group accelerated greatly (d = .51), which proved to be even higher in the lowest and average skill groups (d1 = 1.81; d2 = .92) as well as in the disadvantaged student group (d = .72). Latent-change analyses confirmed the sensitivity, relevance, and importance of developing comprehension at 9−10 years of age and the generalizability of the results (χ2 = 421.5; df = 272; p < .05; CFI = .950; TLI = .945; RMSEA = .045 (CI: .036, .153). The study provided evidence that a well-designed online training program is suitable for developing comprehension and overcoming disadvantages, even without the presence of the teacher outside the classroom.

Evaluating item difficulty patterns for assessing student misconceptions in science across physics, chemistry, and biology concepts.

Understanding item difficulty in science concepts is essential for teachers in teaching and learning to avoid student misconceptions. This study aims to evaluate the patterns of item difficulty estimates in science concepts exploring student misconceptions across physics, biology, and chemistry and to explore differential item functioning (DIF) items in the developed diagnostic test on the basis of gender and grade. Participants were drawn from 856 students (52.3% females and 47.7% males) comprising senior high school students from 11th to 12th grades and pre-service science teachers in the West Kalimantan province, Indonesia. Out of 16 science concepts categorized, the common science concepts causing misconceptions among students were investigated to understand item difficulty patterns using Rasch measurement. The findings of this study evaluated that 32 developed items are valid and reliable whereby the item difficulty estimates ranged from -5.13 logits to 5.06 logits. Chemistry is the scientific discipline with the highest mean logits than other disciplines. There is no significant item difficulty estimate across the science disciplines. We also found DIF issues in one item based on gender and four items based on grade. This study contributes a significant role in mapping and informing item difficulty patterns in science concepts to tackle teachers' problems in assessing and teaching science concepts to improve the students' science performance. Future studies and limitations are also discussed.

Making the Psychological Dimension of Learning Visible: Using Technology-Based Assessment to Monitor Students' Cognitive Development.

Technology-based assessment offers unique opportunities to collect data on students' cognitive development and to use that data to provide both students and teachers with feedback to improve learning. The aim of this study was to show how the psychological dimension of learning can be assessed in everyday educational practice through technology-based assessment in reading, mathematics and science. We analyzed three related aspects of the assessments: cognitive development, gender differences and vertical scaling. The sample for the study was drawn from primary school students in Grades 1-8 (ages 7 to 14) in Hungary. There were 1500 to 2000 students in each grade cohort. Online tests were constructed from 1638 items from the reading, mathematics, and science domains in the eDia system. The results confirmed that the disciplinary, application and psychological dimensions of learning can be distinguished empirically. Students' cognitive development was the most steady (and effective) in mathematics, where the greatest development occurred in the first years of schooling. Path models suggested that the psychological dimension of learning can be predicted at a moderate level based on students' level of school knowledge consisting of the disciplinary and application dimensions of learning as latent constructs. The predictive power was almost the same in both dimensions. Generally, girls developed faster in the psychological dimension of reading, mathematics and science learning; however, the size of gender differences varied by age and domain. This study (1) provides evidence that the psychological dimension of learning can be made visible even in an educational context, (2) highlights the importance of the explicit development of the psychological dimension of learning during school lessons, and (3) shows that there are gender differences in the developmental level of the psychological dimension of learning in favor of girls but that this varies by grade and domain.

Online Diagnostic Assessment in Support of Personalized Teaching and Learning: The eDia System.

The aims of this paper are: to provide a comprehensive introduction to eDia, an online diagnostic assessment system; to show how the use of technology can contribute to solve certain crucial problems in education by supporting the personalization of learning; and to offer a general reference for further eDia-based studies. The primary function for which the system is designed is to provide regular diagnostic feedback in three main domains of education, reading, mathematics, and science, from the beginning of schooling to the end of the 6 years of primary education. The cognitive foundations of the system, the assessment frameworks, are based on a three-dimensional approach in each domain, distinguishing the psychological (reasoning), the application, and the disciplinary (curricular content) dimensions of learning. The frameworks have been carefully mapped into item banks containing over a 1,000 innovative (multimedia-supported) items in each dimension. The online assessments were piloted, and the system has been operating in experimental mode in over 1,000 schools for several years. This paper outlines the theoretical foundations of the eDia system and summarizes how results from research on the cognitive sciences, learning and instruction, and technology-based assessment have been integrated into a working system designed to assess a large population of students. The paper describes the main functions of eDia and discusses how it supports item writing, constructing tests, online test delivery, automated scoring, data processing, scaling and the provision of feedback both for students and teachers. It shows how diagnostic assessments can be implemented in school practice to facilitate differentiated instruction through regular measurements and to provide instruments for teachers to make formative assessments. Beyond its main function (supporting development toward personalizing education), the eDia platform has been used for assessments in a number of areas from pre-school to higher education both in Hungary and in a number of other countries as well. The paper also reviews results from eDia-based studies and highlights how technology-based assessment extends the possibilities of educational research by making more constructs measurable.

The Efficacy and Development of Students' Problem-Solving Strategies During Compulsory Schooling: Logfile Analyses.

The purpose of this study was to examine the role of exploration strategies students used in the first phase of problem solving. The sample for the study was drawn from 3rd- to 12th-grade students (aged 9-18) in Hungarian schools (n = 4,371). Problems designed in the MicroDYN approach with different levels of complexity were administered to the students via the eDia online platform. Logfile analyses were performed to ascertain the impact of strategy use on the efficacy of problem solving. Students' exploration behavior was coded and clustered through Latent Class Analyses. Several theoretically effective strategies were identified, including the vary-one-thing-at-a-time (VOTAT) strategy and its sub-strategies. The results of the analyses indicate that the use of a theoretically effective strategy, which extract all information required to solve the problem, did not always lead to high performance. Conscious VOTAT strategy users proved to be the best problem solvers followed by non-conscious VOTAT strategy users and non-VOTAT strategy users. In the primary school sub-sample, six qualitatively different strategy class profiles were distinguished. The results shed new light on and provide a new interpretation of previous analyses of the processes involved in complex problem solving. They also highlight the importance of explicit enhancement of problem-solving skills and problem-solving strategies as a tool for knowledge acquisition in new contexts during and beyond school lessons.

Potential for Assessing Dynamic Problem-Solving at the Beginning of Higher Education Studies.

There is a growing demand for assessment instruments which can be used in higher education, which cover a broader area of competencies than the traditional tests for disciplinary knowledge and domain-specific skills, and which measure students' most important general cognitive capabilities. Around the age of the transition from secondary to tertiary education, such assessments may serve several functions, including selecting the best-prepared candidates for certain fields of study. Dynamic problem-solving (DPS) is a good candidate for such a role, as tasks that assess it involve knowledge acquisition and knowledge utilization as well. The purpose of this study is to validate an online DPS test and to explore its potential for assessing students' DPS skills at the beginning of their higher education studies. Participants in the study were first-year students at a major Hungarian university (n = 1468). They took five tests that measured knowledge from their previous studies: Hungarian language and literature, mathematics, history, science and English as a Foreign Language (EFL). A further, sixth test based on the MicroDYN approach, assessed students' DPS skills. A brief questionnaire explored learning strategies and collected data on students' background. The testing took place at the beginning of the first semester in three 2-h sessions. Problem-solving showed relatively strong correlations with mathematics (r = 0.492) and science (r = 0.401), and moderate correlations with EFL (r = 0.227), history (r = 0.192), and Hungarian (r = 0.125). Weak but still significant correlations were found with certain learning strategies, positive correlations with elaboration strategies, and a negative correlation with memorization strategies. Significant differences were observed between male and female students; men performed significantly better in DPS than women. Results indicated the dominant role of the first phase of solving dynamic problems, as knowledge acquisition correlated more strongly with any other variable than knowledge utilization.