ABSTRACT
Introducción: El objetivo de esta investigación fue confirmar la estructura interna de la Environmental Reward Observation Scale (EROS) y recoger evidencias de su relación con otros constructos en una muestra colombiana de 902 adultos que consintieron participar voluntariamente. Método: Se realizaron análisis psicométricos con Teoría Clásica de los Test y el modelo de Rasch. Se recolectaron evidencias de validez de la estructura interna y de la relación de las puntuaciones con otras variables. Resultados: Se obtuvieron buenos índices en los coeficientes alfa y omega de McDonald, nueve de los 10 ítems tuvieron buenos ajustes en los índices infit y outfit, y el ítem ocho presentó DIF en el nivel educativo. Se confirmó la estructura unidimensional de la EROS y fue invariante respecto al sexo y nivel educativo. Los puntajes tuvieron correlaciones de magnitud alta con sintomatología emocional y variables afines a la Activación Conductual. Conclusiones: La EROS presentó altas calidades psicométricas para su uso en población colombiana; sin embargo, se recomienda su uso solo para evaluación de tamizaje, porque los niveles de información están centrados en un área reducida a lo largo de la métrica logit.
Introduction: The aim of this research was to confirm the internal structure of the Environmental Reward Observation Scale (EROS) and to collect evidence of its relationship with other constructs in a Colombian sample of 902 adults who voluntarily consented to participate. Method: Psychometric analyses were performed using Classical Test Theory and the Rasch model. Evidence of validity based on internal structure and relations of scores with other variables was collected. Results: Good indexes were obtained in McDonald's Alpha and Omega coefficients, 9 of the 10 items had good adjustments in the Infit and Outfit indexes, and item 8 presented DIF in the educational level. The unidimensional structure of the EROS was confirmed and was invariant with respect to sex and educational level. Scores had high magnitude correlations with emotional symptomatology and variables related to Behavioral Activation. Conclusions: The EROS presented high psychometric qualities for its use in the Colombian population; however, its use is recommended only for screening assessment because the levels of information are centered in a reduced area along the Logit scaling.
ABSTRACT
Background: Little is known about the role of emotion regulation in driving. This study analyzed the psychometric properties of one of the most commonly-used tests for the evaluation of emotion regulation in a drivers sample. Methods: A total of 318 male drivers (M age = 41.6 years, SD = 11.1, age range 20-69 years, half with road traffic offences and half, matched controls), participated in the study by filling out the Emotion Regulation Questionnaire (ERQ). Data analysis was carried out using the Rasch Rating Scale Model (RSM). Results: The performance of the response categories was inadequate. After collapsing the seven original response categories into three, the categories were functional, the unidimensionality requirement was met, and data-model fit was adequate. Both person reliability and item reliability were adequate for the two subscales of ERQ. There was a significant difference between the two groups in the cognitive reappraisal subscale. Conclusions: Given the adequate psychometric properties of the ERQ, it is suggested that the role of cognitive reappraisal in driving contexts be explored in depth.(AU)
Antecedentes: No es mucho lo que se conoce sobre el papel de la regulación emocional en la conducción. Analizamos las propiedades psicométricas de uno de los test más utilizados para la evaluación de la regulación emocional en una muestra de conductores. Métodos: un total de 318 conductores varones (M = 41.6 años, DT = 11.1, rango de edad 20-69 años; la mitad con infracciones de tráfico y la mitad restante, controles emparejados), cumplimentaron el cuestionario de regulación de emociones (ERQ en inglés). El análisis de los datos se llevó a cabo mediante el modelo de Rasch para escalas de calificación. Resultados: El funcionamiento de las categorías de respuesta fue inadecuado. Tras reducir las siete categorías de respuesta originales a tres, las categorías resultaron funcionales, se cumplía el requisito de unidimensionalidad y el ajuste de los datos con el modelo fue adecuado. Tanto la fiabilidad de las personas como la de los ítems fueron adecuadas en las dos subescalas del ERQ. Se halló una diferencia significativa entre los grupos de estudio en la subescala de revaluación cognitiva. Conclusiones: Dadas las adecuadas propiedades psicométricas del ERQ, se sugiere explorar en profundidad el papel de la revaluación cognitiva en contextos de conducción.(AU)
Subject(s)
Humans , Male , Psychometrics , Homeostasis , Automobile Driving , Emotions , Behavior , Spain , Psychology , Psychology, Clinical , Psychology, SocialABSTRACT
A Bateria de Provas de Raciocínio (BPR-5) é um instrumento bastante utilizado para avaliação da inteligência no Brasil, possuindo três formas: infantil (1º ao 6º ano do Ensino Fundamental), Forma A (7º ao 9º ano do Ensino Fundamental) e Forma B (Ensino Médio e Superior). Visando a possibilidade de comparar os resultados entre sujeitos que respondem a formas diferentes, o presente estudo objetivou: (a) calibrar os itens das três formas pelo modelo de Rasch, realizando a equalização por itens comuns de modo a obter uma escala equiparável para as três formas, (b) atualizar as normas expandindo a representatividade das amostras e produzindo-se normas para diferentes combinações de idade, escolaridade e sexo, (c) descrever padrões de desenvolvimento da inteligência a partir da escala, comum, produzida entre 6 e 52 anos. Dois estudos foram relatados, o primeiro sobre a calibração dos parâmetros segundo o modelo de Rasch indicando um bom ajuste ao modelo. O segundo estudo exemplificou a utilização de regressão múltipla para criação de normas para testes psicológicos, considerando as variáveis idade, escolaridade e sexo como preditoras dos escores na BPR-5. Essas três variáveis tiveram efeitos significativos explicando 8% (Raciocínio Abstrato), 13% (Raciocínio Verbal), 12% (Raciocínio Espacial), 8% (Raciocínio Numérico) e 22% (Raciocínio Mecânico).(AU)
The Reasoning Tests Battery (BPR-5) is widely used in Brazil for the assessment of intelligence. It has three different forms: children (1st to 6th grade of elementary school), Form A (7th to 9th grade of elementary school) and Form B (high school and higher education). This study describes the steps followed to create a common metric across the forms. It aimed to: (a) calibrate the items of the three forms using Rasch model, link items and equate subjects' scores across forms using the anchoring of common items method, (b) update the norms by expanding the representativeness of the samples by producing norms for different combinations of age, education and sex, and (c) describe the developmental patterns of the BPR-5 subtests across a wide age range, from 6 to 52 years. We present two studies, the first reporting the calibration of item and person parameters with the Rasch model and a good fit to the model. The second illustrated the use of multiple regression analysis to create norms for the psychological tests considering the variables age, education and gender as predictors of the BPR-5 scores. These three variables had significant effects explaining 8% (Abstract Reasoning), 13% (Verbal Reasoning), 12% (Spatial Reasoning), 8% (Numerical Reasoning) and 22% (Mechanical Reasoning) of the variance. (AU)
La Batería de Pruebas de Razonamiento (BPR-5) es un instrumento muy utilizado para la evaluación de la inteligencia en Brasil, disponiendo de tres formas: infantil (1° al 6° año de la Enseñanza Fundamental), Forma A (7° al 9° año de la Enseñanza Fundamental) y Forma B (Bachillerato y Educación Superior). Teniendo como finalidad la posibilidad de comparar los resultados entre sujetos que responden a diferentes versiones, el presente estudio tuvo como objetivo: (a) calibrar los ítems de las tres formas por el modelo de Rasch, realizando la igualación por ítems comunes a fin de obtener una escala equiparable para las tres formas, (b) actualizar las normas ampliando la representatividad de las muestras y produciendo normas para diferentes combinaciones de edad, escolarización y sexo, (c) describir patrones de desarrollo de la inteligencia a partir de la escala, común, producida entre los 6 y los 52 años. Dos estudios fueron reportados, el primer sobre la calibración de los parámetros de acuerdo con el modelo de Rasch, indicando un buen ajuste al modelo. El segundo estudio ejemplificó la utilización de regresión múltiple para crear normas para tests psicológicos, considerando las variables edad, educación y sexo como predictivos de los escores en el BPR-5. Esas tres variables tuvieron efectos significativos explicando 8% (Razonamiento Abstracto), 13% (Razonamiento Verbal), 12% (Razonamiento Espacial), 8% (Razonamiento Numérico), y 22% (Razonamiento Mecánico).(AU)
Subject(s)
Humans , Male , Female , Child , Adolescent , Adult , Middle Aged , Young Adult , Intelligence , Intelligence Tests/standards , Psychometrics , Calibration/standards , Regression Analysis , Educational Status , Age and Sex DistributionABSTRACT
Resumen Con el cambio en los patrones demográficos y las mejoras en los sistemas de salud, se espera un aumento de la población adulta mayor en el mundo y especialmente en América Latina. Esto genera un aumento en la prevalencia de enfermedades crónicas y degenerativas; una de ellas es la depresión. La depresión supone costos sociales y financieros que pueden causar trastornos a la salud y a la vida cotidiana de quien la padece y de quienes están alrededor, ya que conduce a una morbilidad y mortalidad altas. El presente estudio pretende proporcionar más evidencia psicométrica sobre la idoneidad dela Escala corta de Yessavage (GDS-15) como instrumento para identificar síntomas depresivos en varias poblaciones de adultos mayores, sin patologías específicas, de diferentes países de Latinoamérica. Se utilizaron los datos de los estudios de la Encuesta sobre Salud, Bienestar y Envejecimiento en América Latina y el Caribe (SABE) y Costa Rica, y el Estudio de Longevidad y Envejecimiento Saludable (CRELES). Se hizo uso de la teoría clásica de los tests y un modelo de Rasch. Se encontró que la escala presenta buenos indicadores de consistencia interna con Alphas de Cronbach superiores a .8 en la mayoría de los países. Cuando se evalúa con el modelo de Rasch se identifican varios ítems que no ajustan al modelo, lo que podría relacionarse con los contextos culturales o al hecho de ser población general, por lo que se sugiere que se evalúe el efecto de factores sociales, demográficos, culturales, educativos, roles de género y red de apoyo social en un modelo multinivel.
Abstract Changes in demographic patterns, as well as improvements in health systems, increase the elderly population in the world and especially in Latin America. These processes increase the prevalence of chronic and degenerative diseases such as depression. Depression involves social and financial costs that can cause disorders to the health and daily life of those who suffer from it and those around them, such as high morbidity and mortality. This study uses classical test theory and Rasch model to seek for psychometric evidence to support the suitability of Yesavage's short-scale questionnaire (GDS-15) as a suitable instrument to identify depressive symptoms in general older adult populations in Latin America. The unidimensionality of the scale in each country was validated by performing a factorial analysis of principal components with a tetrachoric correlation matrix. Cronbach's Alpha was also calculated as an indicator of the internal validity of the scale and in order to provide the values of this indicator and compare it with other studies. Using a Rasch model, this study evaluated whether there are items that present difficulties in being answered or, conversely, that do not contribute to the measurement of depression. The Rasch analysis is based on a mathematical model that describes the relationship between the probability of a correct response to an item and the difference between the ability of the respondent. This model allows the joint measurement of people and items in the same construct. By doing this, a person's interpretation of scores is richer than just ranking from percentiles. The Survey on Health, Well-Being, and Aging in Latin America and the Caribbean (Project SABE) was used, a cross-sectional study that examines health conditions and functional limitations of persons aged 60 and older in the countries of Argentina, Barbados, Brazil, Chile, Cuba, Mexico, and Uruguay. This study also used the Costa Rican Longevity and Healthy Aging Study (CRELES), a set of nationally representative longitudinal surveys of health and life course experiences of older Costa Ricans. The scale shows good internal consistency. Cronbach's Alpha was 0.8 and more in most countries. Nevertheless, the Rasch model identified some items that do not fit the model. These items are: "Have you dropped or doing less of many of your activities and interests?", "Were you afraid that something bad was going to happened to you?", "Did you prefer to stay at home instead of going out and doing new things?", "Did you feel you have more problems with your memory that other people your age?", "Did you feel full of energy?", "Did you think that most people were better off than you?". It is important to mention that these items also present drafting problems. In the case of the item "Did you prefer to stay at home instead of going out and doing things?", it can be thought that in the case of some Latin American countries, the preference for staying at home could be more related to the social and political context in which you live with depression. On the other hand, these results also invite us to think about the existence of various dimensions on this scale. Lack of fit is related to cultural contexts or to the fact that the data refers to a general population. Social, demographic, cultural, educational factors, gender roles, and social support networks could be evaluated in a multilevel model.
ABSTRACT
In the 1930s, a group of scientists argued that the empirical concatenation of observable elements was not possible in the human and social sciences and was, thus, not feasible to obtain objective measurements similar to those found in physics. To address this issue, mathematical theories that do not require concatenation were proposed in the 1960s, including the Additive Conjoint Measurement Theory (ACMT). In the same decade, George Rasch developed the simple logistic model for dichotomous data as a probabilistic operationalization of the ACMT. This study investigates the possibility of developing a fundamental measure for the National Exam of Upper Secondary Education (ENEM) that applies Rasch's model to students' performance on the 2011 ENEM exam. The results indicate an adequate model fit, demonstrating the viability of a fundamental measure using ENEM data. Implications are discussed.
Nos anos 1930, um grupo de cientistas argumentou que a concatenação empírica de elementos observáveis não seria possível nas Ciências Humanas e Sociais e por isso era inviável obter medidas verdadeiras nesses campos do conhecimento científico. Para lidar com este problema, foram propostas teorias matemáticas nas quais a concatenação empírica não seria necessária, como a Teoria de Medidas Aditivas Conjuntas (TMAC). No mesmo período, George Rasch desenvolveu o modelo logístico simples para dados dicotômicos, uma operacionalização probabilística da TMAC que viabiliza a análise empírica de pressupostos da medida verdadeira. Em nosso estudo, investigamos o desenvolvimento de uma medida verdadeira para o Exame Nacional do Ensino Médio (ENEM), aplicando o modelo logístico simples em dados referentes à performance dos participantes da edição de 2011 do ENEM. Os resultados indicaram um ajuste adequado do modelo, apontando para a viabilidade da construção de uma medida verdadeira para o ENEM. Implicações são discutidas.
En los años 1930, un grupo de científicos argumentó que la concatenación empírica de elementos observables no sería posible en Ciencias Humanas y Sociales y por consiguiente sería inviable obtener medidas verdaderas similares a las de Física. Para abordar este problema, a partir de los años 1960 se proponían teorías en las cuales la concatenación empírica no es necesaria, como la Teoría de Medidas Aditivas Conjuntas (TMAC). Al mismo período, George Rasch desarrolló el modelo logístico simple para datos dicotómicos, una operacionalización probabilista de la TMAC. Este estudio investigó la posibilidad de desarrollar una medida verdadera para el Examen Nacional de la Secundaria Superior (ENEM), aplicando el modelo logístico simple en los datos referentes a la performance de los participantes en la prueba de 2011 del ENEM. Los resultados indicaron adecuado ajuste del modelo, asi como la viabilidad de una medida verdadera para el ENEM. Implicaciones son discutidas.
Subject(s)
Humans , Knowledge , Education, Primary and Secondary , Growth and Development , Educational Measurement , Social Sciences , Students , Weights and Measures , Brazil , Logistic Models , HumanitiesABSTRACT
Resumen Si bien es común ver en la práctica clínica deficiencias en la motivación en usuarios de marihuana, no ha sido firmemente establecida la existencia de un posible síndrome amotivacional asociado con el consumo de esta droga, entre otras razones por la concurrencia de factores como la depresión que pueden llevar a generalizar inadecuadamente la situación de algunos usuarios de la sustancia. Esta investigación se orientó a obtener evidencia acerca de la existencia de deficiencias en la motivación en consumidores de marihuana. Se construyó una batería de preguntas a partir de una revisión y una consulta a expertos, que fue aplicada a una muestra de 1455 participantes, junto con otros instrumentos seleccionados para excluir del análisis a los participantes con depresión, síntomas prefrontales, trastornos por uso de alcohol, apatía y aplanamiento afectivo, que pudieran confundir los resultados. Se aplicaron métodos estadísticos y psicométricos basados en el modelo de Rasch, para establecer qué comportamientos serían más característicos de una deficiencia motivacional en consumidores habituales de marihuana. Se estimó que un 54.9 % de los participantes tendría un trastorno grave por uso de marihuana, un 54.0 %, síntomas de aplanamiento afectivo y un 60.9 % serían usuarios de marihuana con altos niveles de tetrahidrocannabinol (THC). La media de cigarrillos de marihuana consumidos al mes sería de 44.5. Mediante el modelo de Rasch se estableció que con el conjunto de preguntas construido era posible identificar una dimensión o factor coincidente con una deficiencia motivacional. Se encontró evidencia que sugiere la existencia de apatía emocional; retraimiento social; descuido de la imagen personal y enlentecimiento motor.
Abstract It is common to find marijuana users with alterations in motivation, in clinical practice. Several studies have found evidence about a possible amotivational syndrome in marijuana users, both from the analysis of behavior and from the neurological examination. However, the existence of such a syndrome associated with the use of marijuana has not been firmly established, among other reasons, due to the concurrence of factors such as depression and the use of other drugs that may lead to inadequate generalization of the situation of some consumers of the substance and due to methodological difficulties in research aimed at establishing whether or not there is a decrease in the general motivation associated with the use of marijuana. Likewise, the decrease in motivation could be the result of the disorder by substances rather than by the consumption of marijuana. Due to the growing use of marijuana in the world, the study of its consequences is of the greatest importance, for the design of better treatments for people with substance use disorders. The aim of this study was to obtain evidence about the existence or not of deficiencies in the motivation of marijuana users. In addition, we sought to establish which are the characteristic behaviors that show this possible reduction of motivation. A battery of questions was constructed from a systematic literature review in PubMed, Lilacs, MedLine, Cochrane library, Embase, Science Direct and Bibliomed, using as terms "amotivational syndrome", "amotivation cannabis", "amotivation marijuana", "comorbidity cannabis", "comorbidity marijuaba", "mental disorders and cannabis", "cannabis and mental consequences", "amotivation and drug use". Likewise, an expert consultation was done about behaviors that were indicative of a reduction in the motivation of marijuana users. From the review and consultation of experts, a set of 70 possible behaviors expressed in questions about probable deficiencies in motivation was extracted. These questions, along with other instruments selected to exclude from the analysis participants with depression, prefrontal symptoms, alcohol use disorders, apathy and affective flattening, which could confuse the results, were presented to a sample of 1455 participants. The Rasch model was applied to establish whether it was possible to identify a measurable and consistent dimension that corresponded to a deficiency in motivation, and to discern which behaviors would be most characteristic of a possible motivational deficiency in habitual marijuana users. In addition, an exploratory factor analysis was carried out to identify possible groupings of the characteristic symptoms of a reduction in motivation. Our Results and conclusions show that it was estimated that 54.9 % of the participants would have a serious disorder due to the use of marijuana; 54.0 % presented symptoms of affective flattening, and 60.9 % would be marijuana users with high levels of tetrahydrocannabinol (THC). The average number of cigarettes consumed per month would be 44.5. Using the Rasch model it was established that, with the constructed set of questions, it was possible to identify a dimension or factor coinciding with a motivational deficiency. Using the exploratory factor analysis, it was found that the characteristic behaviors could be grouped into four possible subdimensions: emotional apathy; social withdrawal; neglect of personal image and motor slowdown.
ABSTRACT
En el marco de las políticas públicas en Colombia sobre calidad de la educación superior se encuentran los lineamientos para que el Estado reconozca los programas de pregrado como de alta calidad, entre tales lineamientos se consideran los sistemas de evaluación de los estudiantes basados en políticas institucionales claras y transparentes que propicien una identificación integral de las condiciones académicas y actitudinales de los estudiantes por lo que es imprescindible tecnificar y modernizar los procesos de evaluación para fortalecer la emisión de inferencias confiables sobre el logro académico. En este artículo se describe una aplicación de la Teoría de Grafos usando algunas de sus definiciones y teoremas básicos con la intención de potenciar su uso para el estudio del supuesto de unidimensionalidad de la Teoría de Respuesta al Ítem como alternativa para robustecer la evaluación. La unidimensional fue entendida en el sentido de la homogeneidad escalar y de criterio para las relaciones de orden definidas por la dominación tanto para ítems como para evaluados: para los ítems conforme al número de evaluados que los contestaron correctamente y a la dificultad; para los evaluados respecto al número de respuestas correctas y a la habilidad. Se aplicó la combinación de las dos teorías a un caso de estudio que contempla el instrumento de la prueba diagnóstica del Examen de Clasificación de Matemáticas Básicas en la Universidad Jorge Tadeo Lozano, con esto se ofrece un valor agregado porque se evidencian los resultados de forma algorítmica y visual con ayuda de herramientas informáticas especializadas.
In Colombia, public policies about quality of higher education involve student assessment systems as a relevant characteristic. These systems should have clear and transparent institutional policies requiring comprehensive identification of attitudinal and academic conditions about examinee performance. Consequently, on the way of continuous improvement of academic services offered by institutions of higher education, an assessment process adequately technified allowing valid inferences about academic achievement is required. In this sense, the Rasch measurement model of Item Response Theory is a modern alternative to strengthen educational measurement estimating the ability of the student and the difficulty of the item on a comparable scale. Unidimensionality, local independence and internal consistency are assumptions made in Rasch measurement model. Unidimensionality assumption has several definitions, one of them is the occurrence of a dominant factor influencing test performance. Another definition is considered in the present study. Here, unidimensionality was interpreted as scalar and criterial homogeneity for the order relations defined by domination for items and assessed applicants. Graph Theory is an ideal mathematical modelling approach to this assumption inasmuch as represent intangible interactions as required. In order to achieve this, Graph Theory and Item Response Theory were combined to examine the qualifying test for the Basic Mathematics subject at Jorge Tadeo Lozano University as a case study. This test was composed by 45 items divided in three blocks. With several combinations of these blocks, three virtual booklets were obtained each one comprising 30 of them. From the application of June 2011, a test sample of 509 responses chains was obtained. Three data bases were processed one for each booklet, the first spanned 175 responses chains, the second 170 and the third one 164. To begin with the exmination on the Rasch measurement model, the parameters reliability, separation, Cronbach Alpha and item residual correlation were estimated to gauge and determine performance test for getting acceptable values in each booklet applied. Tatsuoka was followed to undertake the path to unidimensionality from Graph Theory gathering a real case experience processed with suitable software. Additionally, the sensitivity of the order relation was verified through: 1) ordering by number of correct responses per item (1I order) and items difficulty (2I order); 2) ordering by number of correct responses per applicant (1E order) and estimated ability (2E order). Furthermore, the linear models were obtained collating these orders. In like manner, three Guttman scales and their adjacency matrices were schematized one for each booklet. Subsequently, the respective graphs were processed and represented using Gephi just as a specialized tool that enables running some algorithms like Force Atlas. Afterwards, the second power of each adjacency matrix was found using Matlab 2014b and domination matrices were calculated for both items and applicants in the aforementioned orders for a total of 12 matrices. Consistency index developed by Cliff was computed for the domination matrices. As a result, moderate consistency was observed. Significant domination for the entries of these matrices was analyzed through McNemar test in order to have an asymmetric dominance relation. Moreover, a reachable matrix was calculated for each one of these significant domination matrices as a limit ofa sequence of boolean powers. Finally, dominance hierarchies were illustrated with vertex degrees and compared with student maps by the means of Winsteps 3.73. The combination of Graph Theory and Item Response Theory allowed a deeper comprehension of unidimensionality assumption. Thereupon, universities can optimize their resources offering to applicant differential academic options per individual position in the ability scale. The results can be used to outline advantages for the applicants who can evidence their position in the ability scale and identify the different areas to improve.
ABSTRACT
The aim of this research was to assess and to analyze the main writing difficulties presented by second to fifth graders of the elementary school, using Rasch model. Some 413 students from public schools participated, from which 227 (55%) were female. Participants were assessed with Writing Assessment Test, in the syllable, word and pseudoword subtests. Data were analyzed by the Rasch Model. It was verified that more complex structured syllables as consonant-consonant-vogal-consonant were the most difficult. The most difficult words had phonemes that could possibly be represented by more than one grapheme and had accent. In the more difficult pseudowords it was necessary to use well defined orthographic rules, like "m" before "p" and "b". Obtained results can help teachers to anticipate probable student difficulties and to plan differentiated educational strategies.
O objetivo da presente pesquisa foi avaliar e analisar as principais dificuldades de escrita apresentadas por alunos do 2ª ao 5ª ano do Ensino Fundamental, utilizando o modelo de Rasch. Participaram da pesquisa 413 alunos de escolas públicas, sendo 227 (55%) do sexo feminino. Os participantes foram avaliados com o Teste de Avaliação da Escrita, nos subtestes sílabas, palavras e pseudopalavras. Os dados foram analisados a partir do modelo de Rasch. Verificou-se que sílabas com estrutura mais complexa como consoante-consoante-vogal-consoante foram mais difíceis. As palavras mais difíceis apresentaram a possibilidade de um fonema ser representado por mais de um grafema e continham acento. Nas pseudopalavras mais difíceis era necessário empregar regras ortográficas bem definidas como o uso do "m" antes de "p" e "b". Os resultados obtidos podem auxiliar o professor a antecipar as prováveis dificuldades dos alunos e planejar estratégias pedagógicas diferenciadas.
El objetivo de la presente investigación fue evaluar y analizar las principales dificultades de escritura presentadas por alumnos del segundo al quinto curso de la Enseñanza Básica, mediante el uso del modelo de Rasch. Participaron 413 alumnos de escuelas públicas, siendo que 227 (55%) eran del sexo femenino. A los participantes seles evaluó con el Test de Evaluación de la Escritura, en los subtests de sílabas, palabras y pseudopalabras. Se verificó que las sílabas con estructura más compleja como consonante-consonante-vocal-consonante fueron las más difíciles. Las palabras más difíciles presentaron la posibilidad de un fonema ser representado por más de un grafema y contenían tilde. En las pseudopalabras más difíciles era necesario emplear el uso de reglas ortográficas bien definidas como el uso de la "m" antes de la "p" y "b". Los resultados obtenidos pueden auxiliar el profesor a anticipar las probables dificultades de los alumnos y planear estrategias pedagógicas diferenciadas.
Subject(s)
Humans , Male , Female , Students , Education, Primary and Secondary , Educational Measurement , Handwriting , BrazilABSTRACT
Resumen Reconocer y denominar expresiones emocionales son habilidades en cuyo estudio existe un creciente interés por parte de la psicología y las neurociencias; trastornos tales como el autismo, la esquizofrenia y la depresión se caracterizan por dificultades en reconocer las emociones ajenas. El hallazgo de diferencias a favor de las mujeres en Percepción Emocional (PE) ha sido replicado transculturalmente por lo que sirve como evidencia de validez. En esta investigación, de diseño instrumental, se construyeron 28 ítems y se pusieron a prueba mediante el modelo de Rasch (MR) en una muestra de población general española (102 varones y 102 mujeres; rango de edad=18-65). El ajuste datos-modelo fue suficiente. Las medidas de las personas muestran que el test resultó fácil (rango = -.60 a 4.14 logits). Se hallaron las diferencias sexuales predichas, d= -.36 (d con corrección de la atenuación= -.50); que ningún ítem mostrase funcionamiento diferencial (DIF) asociado al sexo y que la variable construida tenga propiedades intervalares añade confianza al valor estimado del tamaño del efecto. La construcción de una escala de intervalo en la que se localizan conjuntamente ítems y personas ofrece información cuantitativa y permite detectar patrones inesperados de respuesta que pueden ser de utilidad para el diagnóstico neuropsicológico.
Abstract Recognizing and labeling emotion expressions are abilities in whose study psychology and the neurosciences are increasingly interested; disorders such as autism, schizophrenia and depression are characterized by difficulties in recognizing others' emotions. The finding of sex differences favoring women in Emotion Perception (EP) has been replicated cross-culturally, and so it can be used as validity evidence. In this instrumental design study, some 28 items were constructed and tested by means of the Rasch model (RM) in a Spanish community sample (102males and 102 females; age range=18-65). Data-model fit was good enough. Person measures show that the test was easy (range = -.60 to 4.14 logits). Even so, the predicted sex differences favoring women were found, d= -.36 (disattenuated d= -.50). That no item showed sex-related Differential Item Functioning (DIF) and that the constructed variable has interval scale properties add confidence to the effect size estimated value. The construction of an interval scale on which EP items and persons are conjointly represented offers quantitative information and allows the discovery of unexpected response patterns.
Subject(s)
Perceptual Disorders , Perception , Emotions , Facial Expression , Aptitude , Sex Characteristics , Depression , DiagnosisABSTRACT
INTRODUCTION: Patient associations form part of health care systems, but little is known about how their members' view the functionality of these associations and whether they endorse their goals and activities. OBJECTIVE: To study how the members of the leading Spanish association of patients with psoriasis and their relatives view the group's functioning. MATERIAL AND METHODS: Survey study using a self-administered questionnaire answered by members of the association (total membership, 26 349 persons). The credibility of the association and respondents' confidence in and satisfaction with it were studied and compared with their attitudes toward other agents in the health care system. A Rasch model was used to analyze respondents' ranking of functions. Analysis of variance was used to study between-group differences. RESULTS: A total of 746 members participated (response rate 2.83%). The association's credibility was rated in second place, after that of specialists who treat psoriasis. Support for the association functions was good (7.53 on a scale of 0 to 10). The function the members rated highest was the raising of societal awareness of psoriasis and its problems. Rated lowest were functions related to personal services for members. Educational level was the only participant factor associated with significant differences in evaluations (P<.05). CONCLUSIONS: The psoriasis association contributes by disseminating information about the disease and patient care, and it serves to represent patients. Health professionals and institutions should take the association into account in their efforts to deal with the disease and in designing effective policies.
Subject(s)
Patients/psychology , Psoriasis , Self-Help Groups , Adult , Female , Humans , Information Dissemination , Internet , Male , Middle Aged , Program Evaluation , Psoriasis/psychology , Quality of Life , Self-Help Groups/organization & administration , Social Support , Socioeconomic Factors , Surveys and QuestionnairesABSTRACT
El objetivo fue construir ítems de comprensión emocional desde la perspectiva del Modelo de Rasch, comparando mediante un experimento aleatorizado los formatos de respuesta verbal/imagen. Participaron 204 sujetos de población general. Se contrastó el efecto del formato (verbal/imagen) y del género en las medidas Rasch de comprensión de emociones de los participantes y se analizó el efecto de la distancia social (cerca/lejos) sobre la dificultad Rasch de los ítems. El formato de respuesta tuvo un efecto significativo sobre las medidas independientemente del género: el formato verbal resultó más fácil que el de imagen. El efecto del género fue significativo, favorable a las mujeres. Los ítems que describían situaciones con receptores cercanos resultaron más fáciles que los que incluían receptores lejanos.
The aim of this study was to construct emotion understanding items from the Rasch Model approach by experimenting through comparison between verbal /image response format. The participants were 204 subjects from a Spanish community sample. A randomized experiment was carried out to test the effect of response format (verbal/ image) and participants' gender on the emotion understanding Rasch measurements. The effect on item difficulty of the social distance (close/far) was also contrasted. No interaction effect was found. Response format had a significant effect on measurement regardless of gender: the verbal response format was easier than the image one. There were significant gender differences on emotion understanding favoring women. Items describing situations with close receivers were significantly easier than the items showing far recipients.
ABSTRACT
Este trabajo muestra la utilidad de un modelo de Rasch (Many-Facet Rasch Measurement, MFRM) para medir la competencia de los examinados, la severidad de los calificadores, la dificultad de las tareas y de las variables puntuadas en las pruebas de respuesta construida que se suelen emplear para evaluar el desempeño. Inicialmente se describe el modelo y sus estadísticos básicos. Finalmente se presenta un ejemplo ilustrativo en el que se analizan, mediante el programa FACETS, las fuentes de la variabilidad de las calificaciones de los estudiantes en un test de expresión escrita. Los resultados muestran que el procedimiento es útil para detectar a los calificadores que presentan valores extremos en la variable severidad/ benignidad y para obtener calificaciones objetivas de los examinados (libres de la severidad del calificador).
This paper describes how a Rasch model (Many-Facet Rasch Measurement) can be applied to performance assessment focusing on analysis of examinee, raters, tasks and variables. The article provides an introduction to MFRM, a description of analysis procedures, and an illustrative example to examine the effects of various sources of variability on students' performance on a writing test by means of the FACETS program. Results highlight the usefulness of the MFRM to detect raters that have extreme values on the continuum of severity/leniency as well as providing objective measurement of examinee (scores free of rater severity).
ABSTRACT
Objetivo Os objetivos do trabalho foram avaliar a validade interna e a capacidade preditiva da escala de segurança alimentar de seis itens aplicada a adolescentes. Métodos Foi um estudo transversal com amostra representativa de adolescentes brasileiros (N=14.690), realizado em escolas públicas e privadas nas 26 capitais de estados brasileiros e no Distrito Federal por meio de questionário online. Resultados A maior parte dos respondentes era do sexo feminino (53,2%), com idade média de 14,4 anos, sendo 72,7% de escolas públicas. O comportamento da escala, observado pelo modelo de Rasch, foi melhor sem o item cinco, apresentando valores ótimos de Infit e nível de severidade crescente entre os itens. O alfa de Cronbach foi 0,77, e as análises do funcionamento diferencial dos itens mostraram comportamento dos itens semelhante entre os subgrupos avaliados. A análise fatorial mostrou a unidimensionalidade do instrumento. Conclusão Foi proposta a retirada do item cinco e novos pontos de corte para a escala curta de segurança alimentar. A escala curta de segurança alimentar é válida e confiável para mensurar insegurança alimentar domiciliar entre adolescentes brasileiros. .
Objective The objective of this study was to evaluate the internal and predictive validity of a six-item household food insecurity scale to measure food insecurity in Brazilian adolescents. Methods A cross-sectional study with a representative sample of Brazilian adolescents (N=14,690) was conducted in public and private schools in 26 state capitals and in the Federal District of Brazil using an online questionnaire. Results Most respondents were female (53.2%) with mean age of 14.4 years, and 72.7% of them attended public schools. The psychometric properties of the scale, assessed using the Rasch model, showed better response rates without the item five, exhibiting optimal Infit statistics and an increasing level of severity among the items. Cronbach's á was 0.767. Differential item functioning analyses showed similar behavior between the items in the subgroups evaluated. Factor analysis confirmed the unidimensionality of the scale. Conclusion This study proposes the removal of the item five and the inclusion of new cut-off points for this short form of the scale. The Household Food Security Scale (short form) is valid and reliable to measure household food insecurity in Brazilian adolescents. .
Subject(s)
Humans , Male , Female , Adolescent , AdolescentABSTRACT
El razonamiento silogístico es parte importante del razonamiento deductivo. El análisis de las fuentes de error en la resolución de silogismos originó, dentro de la psicología cognitiva, explicaciones como el efecto atmósfera, el sesgo de la figura y la conversión ilícita. En este trabajo se ajustó el modelo LLTM de Fischer para identificar componentes de dificultad de silogismos y estimar sus efectos. Se administraron 46 ítems con un diseño de enlace a tres grupos, con un total de 1074 estudiantes universitarios. Para cada par de premisas se debía escoger un esquema de conclusión y completarlo con los términos extremos o reconocer la falta de conclusión válida. El modelo de Rasch se ajustó sobre un subconjunto de 20 silogismos y se aplicó el modelo LLTM de Fischer. Se identificaron, aumentando la dificultad, cuatro componentes: efecto atmósfera y sesgo de figura (cuando éstos están en dirección contraria a la conclusión o no hay conclusión válida), figura II y figura III. El carácter reversible de la conclusión (modos universal negativo y particular afirmativo) y la falta de conclusión válida fueron componentes facilitadores. La correlación entre las estimaciones de los parámetros de dificultad bajo el modelo de Rasch y el LLTM fue 0,96.
Syllogistic reasoning is an important part of deductive reasoning. In cognitive psychology, the analysis of error sources in solving syllogisms produced explanations such as the atmosphere effect, figure bias and wrong conversion. The Fischer Linear Logistic Test Model (LLTM) was fitted on a set of syllogisms in order to identify their difficulty components and estimate their effects. Forty six items were administered with a link design to three groups of 1074 university students. The task consisted in choosing, for each pair of premises, one conclusion scheme and complete it with the suitable terms, if a valid conclusion existed; otherwise, examinees had to select the option of no valid conclusion. The Rasch model was fitted to a subset of 20 syllogisms on which Fischer's LLTM was applied. Four components were identified that increase syllogistic difficulty: atmosphere effect, figure bias (when they follow the opposite direction of the conclusion or when there is no valid conclusion), figure II and figure III. Two components were found that make the task easier: reversibility of conclusion (universal negative and particular affirmative modes) and lack of valid conclusion. Linear correlation between the estimates of difficulty parameters obtained with Rasch and LLTM models was .96.
ABSTRACT
Os objetivos deste estudo foram desenvolver uma versão computadorizada para um teste de reconhecimento associativo, desenvolver itens para a construção e informatização de um teste de reconhecimento de itens, utilizando o modelo de Rasch. Também foi objetivo deste estudo testar as hipóteses dos níveis de dificuldade dos itens e buscar evidência de validade para os instrumentos, averiguando se as mulheres obtêm desempenho superior ao dos homens. Participaram 217 estudantes universitários, homens e mulheres, com idade média de 25 anos. Os resultados indicaram que os testes se ajustaram ao modelo de Rasch, apresentaram índices de fidedignidade adequados e não apresentaram funcionamento diferencial dos itens (DIF). Obteve-se empiricamente a ordem esperada de dificuldade das categorias de itens do teste individual e uma alta correlação entre a ordem de dificuldade esperada dos pares e a ordem obtida dos pares. As mulheres apresentaram um desempenho significativamente superior ao dos homens, que não se deve ao DIF.
The objectives of this study were to develop items for a computerized version of an associative recognition memory test and to develop items for the construction and computerization of an individual recognition memory test, using the Rasch model. This study also aimed to test the hypothesis related to the item difficulty levels and to search for validity evidences for the instruments investigating if there are differences between male and female performance. Two hundred and seventeen college students, male and female, with average age of 25 years, participated in the study. Results indicated that the tests fit the Rasch model, presented adequate reliability index and did not present differential item functioning (DIF). The expected difficulty order of item categories from the individual subtest as well as a large correlation between the pairs expected difficulty order and the pairs obtained order were found. Women presented significantly higher performance than men and it is not due to DIF.
Subject(s)
Humans , Male , Female , Young Adult , Computers , Memory , Psychometrics , Recognition, Psychology , Surveys and QuestionnairesABSTRACT
Os objetivos deste estudo foram desenvolver uma versão computadorizada para um teste de reconhecimento associativo, desenvolver itens para a construção e informatização de um teste de reconhecimento de itens, utilizando o modelo de Rasch. Também foi objetivo deste estudo testar as hipóteses dos níveis de dificuldade dos itens e buscar evidência de validade para os instrumentos, averiguando se as mulheres obtêm desempenho superior ao dos homens. Participaram 217 estudantes universitários, homens e mulheres, com idade média de 25 anos. Os resultados indicaram que os testes se ajustaram ao modelo de Rasch, apresentaram índices de fidedignidade adequados e não apresentaram funcionamento diferencial dos itens (DIF). Obteve-se empiricamente a ordem esperada de dificuldade das categorias de itens do teste individual e uma alta correlação entre a ordem de dificuldade esperada dos pares e a ordem obtida dos pares. As mulheres apresentaram um desempenho significativamente superior ao dos homens, que não se deve ao DIF.(AU)
The objectives of this study were to develop items for a computerized version of an associative recognition memory test and to develop items for the construction and computerization of an individual recognition memory test, using the Rasch model. This study also aimed to test the hypothesis related to the item difficulty levels and to search for validity evidences for the instruments investigating if there are differences between male and female performance. Two hundred and seventeen college students, male and female, with average age of 25 years, participated in the study. Results indicated that the tests fit the Rasch model, presented adequate reliability index and did not present differential item functioning (DIF). The expected difficulty order of item categories from the individual subtest as well as a large correlation between the pairs expected difficulty order and the pairs obtained order were found. Women presented significantly higher performance than men and it is not due to DIF.(AU)
Subject(s)
Humans , Male , Female , Young Adult , Memory , Reproducibility of Results , Psychometrics , Computers , Surveys and QuestionnairesABSTRACT
INTRODUCTION: The clinical use of mindfulness has increased recently, and the Mindful Attention Awareness Scale (MAAS) has become one of the most used tools to measure it. The aim of this study was to test the effectiveness of mindfulness training and analyzing the psychometric properties of the MAAS scores in a clinical sample using the Rasch Model. METHODS: One hundred and ninety-nine participants with mood-anxiety clinical symptoms were recruited. The experimental group (n=103) received mindfulness training, and the control group (n=96) a conventional outpatient treatment for the same duration. The pre-post MAAS scores were analyzed to test the effectiveness of training, the psychometric properties of the scores, and differential item functioning (DIF) using the Rating Scale Model (RSM). RESULTS: Misfit in items 9 and 12, DIF in item 9, and Spanish translation problems in the items 5, 9 and 12 were observed. The repetition of the analysis without these items was decided. Appropriate dimensionality, fit and reliability values were obtained with the short version, MAAS-12. CONCLUSIONS: Contrary to previous studies, the MAAS was sensitive to treatment-associated change. However, the commonly used MAAS has some translation and metric problems, and should be revised. MAAS-12 is a better scale than MAAS but suffers from construct under-representation. Constructing tools from a coherent theoretical perspective is suggested, so that all mindfulness facets are represented.
Subject(s)
Attention , Awareness , Mindfulness , Adolescent , Adult , Anxiety/psychology , Depression/psychology , Female , Humans , Language , Male , Middle Aged , Psychometrics , Surveys and Questionnaires , Translations , Young AdultABSTRACT
Dynamic testing, with an intermediate phase of assistance, measures changes between pretest and post-test assuming a common metric between them. To test this assumption we applied the Item Response Theory in the responses of 69 children to dynamic cognitive testing Children's Analogical Thinking Modifiability Test adapted, with 12 items, totaling 828 responses, with the purpose of verifying if the original scale yields the same results as the equalized scale obtained by Item Response Theory in terms of "changes quantifying". We followed the steps: 1) anchorage of the pre and post-test items through a cognitive analysis, finding 3 common items; 2) estimation of the items' difficulty level parameter and comparison of those; 3) equalization of the items and estimation of "thetas"; 4) comparison of the scales. The Children's Analogical Thinking Modifiability Test metric was similar to that estimated by the TRI, but it is necessary to differentiate the pre and post-test items' difficulty, adjusting it to samples with high and low performance...
Provas assistidas, com fase intermediária de ensino, medem mudanças entre pré-teste e pós-teste pressupondo uma métrica comum entre eles. Para testar este pressuposto, aplicou-se a Teoria de Resposta ao Item nas respostas de 69 crianças à prova cognitiva assistida Children's Analogical Thinking Modifiability Test adaptada, com 12 itens, totalizando 828 respostas, para verificar se a escala original produzia os mesmos resultados em termos de quantificação de mudança que a escala equalizada obtida via Teoria de Resposta ao Item. Seguiram-se os passos: 1) ancoragem dos itens de pré e pós-teste, por uma análise cognitiva, encontrando-se três itens em comum; 2) estimação do parâmetro de dificuldade dos itens e comparação destes; 3) equalização dos itens e estimação dos "thetas"; 4) comparação das escalas. A métrica do Children's Analogical Thinking Modifiability Test foi semelhante à estimada pela Teoria de Resposta ao Item, mas é preciso diferenciar a dificuldade dos itens de pré e pós-teste, adequando-o a amostras com alto e baixo desempenho...
Subject(s)
Humans , Benchmarking , PsychometricsABSTRACT
Dynamic testing, with an intermediate phase of assistance, measures changes between pretest and post-test assuming a common metric between them. To test this assumption we applied the Item Response Theory in the responses of 69 children to dynamic cognitive testing Children's Analogical Thinking Modifiability Test adapted, with 12 items, totaling 828 responses, with the purpose of verifying if the original scale yields the same results as the equalized scale obtained by Item Response Theory in terms of "changes quantifying". We followed the steps: 1) anchorage of the pre and post-test items through a cognitive analysis, finding 3 common items; 2) estimation of the items' difficulty level parameter and comparison of those; 3) equalization of the items and estimation of "thetas"; 4) comparison of the scales. The Children's Analogical Thinking Modifiability Test metric was similar to that estimated by the TRI, but it is necessary to differentiate the pre and post-test items' difficulty, adjusting it to samples with high and low performance.(AU)
Provas assistidas, com fase intermediária de ensino, medem mudanças entre pré-teste e pós-teste pressupondo uma métrica comum entre eles. Para testar este pressuposto, aplicou-se a Teoria de Resposta ao Item nas respostas de 69 crianças à prova cognitiva assistida Children's Analogical Thinking Modifiability Test adaptada, com 12 itens, totalizando 828 respostas, para verificar se a escala original produzia os mesmos resultados em termos de quantificação de mudança que a escala equalizada obtida via Teoria de Resposta ao Item. Seguiram-se os passos: 1) ancoragem dos itens de pré e pós-teste, por uma análise cognitiva, encontrando-se três itens em comum; 2) estimação do parâmetro de dificuldade dos itens e comparação destes; 3) equalização dos itens e estimação dos "thetas"; 4) comparação das escalas. A métrica do Children's Analogical Thinking Modifiability Test foi semelhante à estimada pela Teoria de Resposta ao Item, mas é preciso diferenciar a dificuldade dos itens de pré e pós-teste, adequando-o a amostras com alto e baixo desempenho.(AU)
Subject(s)
Benchmarking , PsychometricsABSTRACT
El objetivo del presente estudio se ha centrado en la calibración de la versión española de la escala reducida de 10 ítems (Indice de Hiperactividad de Conners [IHC]) mediante el modelo de Rasch, utilizando una muestra de 482 niños de 5 y 6 años. Los resultados mostraron que el IHC tiene buenas propiedades psicométricas. El ajuste, tanto de los ítems como de las personas al modelo de Rasch, es bueno y las categorías de respuesta funcionan adecuadamente. Las puntuaciones de los niños fueron significativamente superiores a las de las niñas. Tres de los ítems tienen riesgo de presentar Funcionamiento Diferencial del Ítem (DIF) en función del género. El IHC tiene un evidente efecto suelo que impide evaluar a niños con niveles de hiperactividad bajos.
Conners Hyperactivity Index or Conners 3-AI using the Rasch model. The participants in this study were 482 children aged 5 and 6 years old. Results showed that the IHC has good psychometric properties. The fit of both items and persons data to Rasch model was good, and the response categories were functioning properly. Boys scored significantly higher than girls. Three of the items were at risk of gender-specific DIF. The Conners 3-AI has an obvious floor effect, which prevents the evaluation of children with low levels of hyperactivity.