RESUMEN
Introduction: Associating multimodal information is essential for human cognitive abilities including mathematical skills. Multimodal learning has also attracted attention in the field of machine learning, and it has been suggested that the acquisition of better latent representation plays an important role in enhancing task performance. This study aimed to explore the impact of multimodal learning on representation, and to understand the relationship between multimodal representation and the development of mathematical skills. Methods: We employed a multimodal deep neural network as the computational model for multimodal associations in the brain. We compared the representations of numerical information, that is, handwritten digits and images containing a variable number of geometric figures learned through single- and multimodal methods. Next, we evaluated whether these representations were beneficial for downstream arithmetic tasks. Results: Multimodal training produced better latent representation in terms of clustering quality, which is consistent with previous findings on multimodal learning in deep neural networks. Moreover, the representations learned using multimodal information exhibited superior performance in arithmetic tasks. Discussion: Our novel findings experimentally demonstrate that changes in acquired latent representations through multimodal association learning are directly related to cognitive functions, including mathematical skills. This supports the possibility that multimodal learning using deep neural network models may offer novel insights into higher cognitive functions.
RESUMEN
La resolución de problemas aritméticos es una actividad cognitiva compleja, de particular dificultad para niños y niñas, que implica poder identificar los componentes relevantes, las relaciones entre ellos y poder llevar a cabo los cómputos necesarios. Distintos estudios han buscado las variables predictoras de esta capacidad, centrándose en uno de dos aspectos: la competencia matemática del niño/a o su comprensión de texto. El propósito del presente trabajo consistió en estudiar si la incidencia de uno u otro sobre la resolución de problemas en niños y niñas de 4 y 5 años se modifica por la inclusión simultánea de ambos en un modelo de ecuaciones estructurales. A su vez, existe amplia evidencia que sugiere que habilidades de dominio general, como la memoria de trabajo, influyen significativamente sobre la capacidad matemática y de comprensión de texto de los sujetos. Por este motivo, se estudió, adicionalmente, la presencia de un efecto indirecto de la memoria de trabajo verbal y visoespacial y del conocimiento previo sobre la resolución de problemas aritméticos, mediado por las otras dos habilidades. Los resultados obtenidos sugieren que, a esta edad, solo la habilidad matemática tiene un efecto directo significativo sobre la resolución de problemas, y la memoria de trabajo, tanto visual como verbal, un efecto indirecto. Asimismo, se observó que ambos componentes de la memoria de trabajo se vinculan con la capacidad matemática, pero sólo la verbal con la comprensión de texto. Por otro lado, el conocimiento previo sólo parece vincularse con la comprensión
The resolution of arithmetic word problems is a complex cognitive activity which requires the subject to identify the relevant elements, the relationships between them and to be able to carry out the necessary computations. Different studies have searched for predictive variables of this capacity, focusing on one of two aspects: the child's mathematical competence or his or her text comprehension. The purpose of the present work was to study if the incidence of one or the other on the resolution of arithmetic problems in children of 4 and 5 years of age is modified by the simultaneous inclusion of both in a structural equation model (SEM). Additionally, there is ample evidence to suggest that general domain abilities, such as working memory, significantly influence the subject's mathematical and comprehension capacity. That is why we also studied the presence of an indirect effect of verbal and visuospatial working memory, as well as the child's previous knowledge, on the resolution of arithmetic problems, mediated by the other two skills. The results suggest that, at this age, only mathematical ability has a significant direct effect on the resolution of problems, and that working memory, both visual and verbal, have an indirect effect over it. Likewise, both components of working memory are linked with mathematical ability, but only verbal working memory with text comprehension. On the other hand, prior knowledge seems to be associated with text comprehension
Asunto(s)
Humanos , Masculino , Femenino , Preescolar , Conceptos Matemáticos , Solución de Problemas , Memoria a Corto PlazoRESUMEN
Epilepsy is one of the most prevalent chronic disorders of childhood which can threaten child development and mental health. Among cognitive disorders, dyscalculia is one of the most important. In this study, 39 children and adolescents with idiopathic epilepsy underwent clinical and neuropsychological assessment to determine the intellectual level, math skills, reading and writing performance and neuropsychological profile. It was observed that the mathematical ability was below schooling expectations in a higher frequency than expected. There were no significant differences in mathematical performance among groups divided by number of antiepileptic drugs used, duration of disease and types and frequency of seizures. There was a positive correlation with intelligence quotient and attentional and reading level. These results suggest the existence not only of dyscalculia, but the concurrence of attentional and reading problems for the poor mathematical performance in this population.
A epilepsia é uma das doenças crônicas mais comuns da infância que pode ameaçar o desenvolvimento infantil e saúde mental. Dos distúrbios cognitivos, a discalculia é um dos mais importantes. Neste estudo, 39 crianças e adolescentes com epilepsia idiopática, foram submetidos à avaliação clínica e neuropsicológica para determinar o nível intelectual, habilidade em matemática, leitura e escrita e perfil neuropsicológico. Observou-se que a habilidade em matemática ficou abaixo das expectativas de escolarização em uma frequência maior do que a esperada. Não houve diferenças significativas no desempenho matemático em relação ao número de drogas antiepilépticas utilizadas, duração da doença, tipo e frequência das crises. Houve uma correlação positiva com o quociente de inteligência e nível de atenção e leitura. Estes resultados sugerem a existência não só de discalculia, mas também a existência de problemas atencionais e de leitura que fatores causais para a dificuldade matemática apresentada nesta amostra.