New Trends in Digital Technology-Based Psychological and Educational Assessment.

BACKGROUND: The emergence of digital technology in the field of psychological and educational measurement and assessment broadens the traditional concept of pencil and paper tests. New assessment models built on the proliferation of smartphones, social networks and software developments are opening up new horizons in the field. METHOD: This study is divided into four sections, each discussing the benefits and limitations of a specific type of technology-based assessment: ambulatory assessment, social networks, gamification and forced-choice testing. RESULTS: The latest developments are clearly relevant in the field of psychological and educational measurement and assessment. Among other benefits, they bring greater ecological validity to the assessment process and eliminate the bias associated with retrospective assessment. CONCLUSIONS: Some of these new approaches point to a multidisciplinary scenario with a tradition which has yet to be created. Psychometrics must secure a place in this new world by contributing sound expertise in the measurement of psychological variables. The challenges and debates facing the field of psychology as it incorporates these new approaches are also discussed.

Nurses' knowledge, skills and personal attributes for competent health education practice: An instrument development and psychometric validation study.

AIM: To develop and psychometrically test the Nurse Health Education Competence Instrument for assessing nurses' knowledge, skills and personal attributes concerning competent health education practice. DESIGN: A psychometric instrument development and validation study. METHODS: A four-step approach was used: Step 1) operational definition based on an up-to-date concept analysis and experts' judgement; step 2) item generation and content validation by expert panel and target population; step 3) item analysis based on acceptability, internal consistency and face validity; and step 4) psychometric evaluation based on construct validity, criterion validity, internal consistency and stability, conducted from January -February 2019 with 458 hospital-care nurses. RESULTS: The operational framework and expert groups showed good content validity, resulting in the first version. From the initial 88-item pool, 58 items were retained after item analysis. Exploratory factor analysis revealed three scales concerning the cognitive (three-factor solution with 23 items), psychomotor (two-factor solution with 26 items) and affective-attitudinal (one-factor solution with nine items) competency domains, which respectively accounted for 58%, 53% and 54% of the variance. Known-group study demonstrated significant differences by years working in the service and training received in health education, providing evidence for the measure's sensitivity. The three scales correlated positively with the criterion variable. Overall Cronbach alphas for the cognitive, psychomotor and affective-attitudinal scales were 0.95, 0.95 and 0.90, respectively. Intraclass correlation coefficients were >0.70. CONCLUSIONS: The newly developed Nurse Health Education Competence Instrument is an original and tested self-reporting psychometric tool, being the first to identify nurses' knowledge, skills and attributes necessary for planning and assessing health education practice competency. IMPACT: The instrument permits measurable insights into nurses' perceptions regarding their health education competence and related educational needs. This study provides a valid and specific learning tool that is appropriate to use both in clinical practice and in nursing education programmes.

Perfil dos psicólogos brasileiros que utilizam testes psicológicos: áreas e instrumentos utilizados / Profile of brazilian psychologists using psychological tests: areas and instruments used / Perfil de los psicólogos brasileños que utilizan pruebas psicológicas: áreas e instrumentos utilizados

Resumo O artigo teve como objetivo apresentar um levantamento sobre o perfil dos psicólogos brasileiros que utilizam testes psicológicos no que tange a sua(s) área(s) de atuação, ao uso que fazem dos instrumentos psicológicos em suas práticas e aos testes que utilizam com maior frequência no exercício profissional. Participaram do estudo 668 psicólogos, que exerciam a profissão, em média, a 14,06 anos (DP = 11,34). Os dados foram coletados em plataforma on-line, por meio de questionário que está sendo utilizado em vários países da América do Sul, divulgado a todos os psicólogos brasileiros com apoio de órgãos da classe. Os resultados obtidos evidenciaram que a Psicologia Clínica e da Saúde são as áreas mais prevalentes de atuação principal dos psicólogos brasileiros. Testes psicológicos são utilizados principalmente para fins psicodiagnósticos. Os grupos etários mais frequentemente cobertos pelas avaliações realizadas são adultos. Os testes psicológicos mais utilizados são destinados a avaliação de personalidade ou inteligência. A lista inclui Teste Palográfico, HTP, Rorschach, Bateria Fatorial de Personalidade e as Escalas Wechsler de Inteligência. Os testes projetivos/expressivos ou gráficos são os mais usuais para avaliação da personalidade. A maioria das respostas obtidas na análise dos cinco testes mais utilizados refere-se a algum teste considerado favorável para uso pelo Satepsi. Destaca-se a extensão da lista dos testes citados, o que indica que os psicólogos estão atentos aos novos instrumentos e às opções de que dispõem para qualificar as avaliações realizadas. Contudo, é grande o número de instrumentos utilizados que não têm avaliação certificada de suas propriedades técnicas.

Abstract This article presents a survey on the profile of Brazilian psychologists who use psychological tests regarding their area(s) of action, their use of psychological instruments in their practices and the tests they use more frequently in their professional practice. A total of 668 psychologists who practiced the profession participated in this study, having average 14.06 years (SD = 11.34). The data were collected with use of an online platform via a questionnaire that is being used in several countries of South America divulged to all Brazilian psychologists with the support of institutions related to the field. The results obtained evidenced that Clinical and Health Psychology are the most prevalent areas of action of Brazilian psychologists. Psychological tests are mainly used for psychodiagnostic purposes. The age groups most frequently covered by the assessments are adults. The most commonly used psychological tests serve for the evaluation of personality or intelligence. The list includes Palographic Test, HTP, Rorschach, Factorial Personality Battery and the Wechsler Intelligence Scales. Projective/expressive or graphical tests are the most common for personality assessment. Most of the answers obtained in the analysis of the five most used tests refer to some test considered favorable for use by Satepsi. It is worth noting the list of cited tests, which indicates that psychologists are attentive to new instruments and the options available to qualify the evaluations performed. However, there is a large number of instruments used that have no certified evaluation of their technical properties.

Resumen El artículo tuvo como objetivo presentar una encuesta sobre el perfil de los psicólogos brasileños que utilizan pruebas psicológicas en lo que se refiere a su/s área/s de actuación, al uso de los instrumentos psicológicos en sus prácticas y a las pruebas que utilizan con mayor frecuencia en el ejercicio profesional. Participaron en el estudio 668 psicólogos, que ejercían la profesión en un promedio de 14,06 años (DE = 11,34). Los datos fueron recopilados en la plataforma online por medio de un cuestionario que está siendo utilizado en varios países de América del Sur, divulgado a todos los psicólogos brasileños con apoyo de órganos profesionales. Los resultados obtenidos evidenciaron que la Psicología Clínica y de la Salud son las áreas más prevalentes de actuación principal de los psicólogos brasileños. Las pruebas psicológicas se utilizan principalmente para fines de psicodiagnóstico. Los grupos de edad más frecuentemente cubiertos por las evaluaciones realizadas son adultos. Las pruebas psicológicas más utilizadas se destinan a evaluar la personalidad o la inteligencia. La lista incluye Prueba Palográfica, HTP, Rorschach, Batería Factorial de Personalidad y las Escalas Wechsler de Inteligencia. Las pruebas proyectivas/expresivas o gráficas son las más usuales para evaluar la personalidad. La mayoría de las respuestas obtenidas en el análisis de las cinco pruebas más utilizadas se refieren a alguna prueba considerada favorable para su uso por Satepsi. Se destaca la extensión de la lista de las pruebas citadas, lo que indica que los psicólogos están atentos a los nuevos instrumentos y a las opciones de que disponen para calificar las evaluaciones realizadas. Sin embargo, hay un gran número de instrumentos utilizados que no tienen una evaluación certificada de sus propiedades técnicas.

Avances, proyectos y retos internacionales ligados al uso de tests en Psicología / International advances, projects and challenges in psychological testing

Resumen El desarrollo de la psicometría y la normalización de la práctica profesional de la Psicología delimitan un espacio marcado por la importancia atribuida al uso correcto de los tests. En entornos sociales y científicos caracterizados por actitudes positivas hacia el uso de tests, disponibilidad de tests de calidad, regulación de la práctica profesional y colaboración internacional, se constituyen las asociaciones de tests nacionales e internacionales. Estas trabajan de forma conjunta en el establecimiento de directrices que, a través de una orientación pragmática, ofrecen guías para la buena práctica. En este trabajo describimos brevemente algunos de los últimos proyectos relacionados con el uso de tests, y apuntamos la importancia de las comisiones y las directrices para mejorar su uso.

Abstract The current development of psychometrics and the standardization of the psychological practice define a context marked by the importance given to the correct use of tests. National and international associations of tests are established in a social and scientific environment characterized by positive attitudes toward the use of tests, availability of quality tests, regulation of professional practice and international collaboration. These associations work together in establishing guidelines that offer guides to best practices by using a pragmatic orientation. In this paper, we briefly describe the latest developments in testing, and we point out the importance of the test commissions and guidelines to improve the use of tests.

Internal Structure and Partial Invariance across Gender in the Spanish Version of the Reasoning Test Battery.

The Reasoning Test Battery (BPR) is an instrument built on theories of the hierarchical organization of cognitive abilities and therefore consists of different tasks related with abstract, numerical, verbal, practical, spatial and mechanical reasoning. It was originally created in Belgium and later adapted to Portuguese. There are three forms of the battery consisting of different items and scales which cover an age range from 9 to 22. This paper focuses on the adaptation of the BPR to Spanish, and analyzes different aspects of its internal structure: (a) exploratory item factor analysis was applied to assess the presence of a dominant factor for each partial scale; (b) the general underlined model was evaluated through confirmatory factor analysis, and (c) factorial invariance across gender was studied. The sample consisted of 2624 Spanish students. The results concluded the presence of a general factor beyond the scales, with equivalent values for men and women, and gender differences in the factorial structure which affect the numerical reasoning, abstract reasoning and mechanical reasoning scales.

Partial scalar invariance and observed differences across gender in a reasoning test battery.

BACKGROUND: The substantive basis of the Reasoning Test Battery (BPR) is the theory of the hierarchical organization of cognitive abilities and therefore, it combines a general cognitive factor and specific factors associated with abstract, numerical, verbal, practical, spatial and mechanical reasoning. The battery has three forms, covering an age range from 9 to 22 years. METHOD: The present study analyzes the internal structure of the Basque version of the battery using exploratory and confirmatory factor analyses. Factorial invariance studies across gender were performed and partial differences observed were analyzed in a sample of 1,923 students. RESULT: The results concluded: (a) the presence of one general reasoning factor in each of the forms, (b) partial scalar invariance across gender affecting mechanical reasoning and numerical reasoning, (c) no differences in the general reasoning factor, and (d) negligible observed differences in partial scales. CONCLUSIONS: Tests for measurement invariance indicate differences in factor intercepts, cautioning that comparisons of observed g scores across gender are not appropriate.

Procedimientos analítico-racionales en la adaptación de tests. Adaptación al español de la batería de pruebas de razonamiento: Adaptation to Spanish of the Reasoning Tests Battery / Judgmental-analytical procedures for adapting tests

Adaptar un test entre culturas o idiomas requiere considerar aspectos legales, culturales, lingüísticos, métricos y de uso. La atención prestada por la literatura especializada a los aspectos metodológicos implicados en el estudio de la equivalencia métrica ha sido significativamente mayor que la dedicada a los procedimientos analítico-racionales previos a la fase de confirmación empírica. Sin embargo, la consideración de estos últimos es crucial en el proceso de adaptación. En esta línea, el objetivo de este trabajo es incidir en la relevancia de las etapas previas y describirlas, ofreciendo una sistematización que considera diez apartados. Todos ellos contribuyen a garantizar y favorecer la construcción de un test adaptado y equivalente, en la medida de lo posible, al test original. El proceso es ejemplificado con la adaptación al español de una prueba cognitiva construida en portugués para la población portuguesa, la Bateria de Provas de Raciocínio.

Adapting a test between cultures or languages requires taking into account legal, linguistic, metric, and use-related considerations. Significantly more attention has been paid to the methodological aspects involved in the study of metric equivalence than to judgmental-analytical procedures prior to the empirical confirmation stage. However, considering the latter is crucial in the adaptation process. Along these lines, this paper seeks to describe and focus on the relevance of the previous stages, thereby offering a systematization process that comprises ten sections. This approach contributes to ensuring the construction of a test adapted and equivalent in as much as possible to the original. This process is exemplified by means of a Spanish language adaptation of a cognitive test originally designed in Portuguese for the Portuguese population, the Reasoning Test Battery.

[International Test Commission Guidelines for test translation and adaptation: second edition]. / Directrices para la traducción y adaptación de los tests: segunda edición.

BACKGROUND: Adapting tests across cultures is a common practice that has increased in all evaluation areas in recent years. We live in an increasingly multicultural and multilingual world in which the tests are used to support decision-making in the educational, clinical, organizational and other areas, so the adaptation of tests becomes a necessity. The main goal of this paper is to present the second edition of the guidelines of the International Test Commission (ITC) for adapting tests across cultures. METHOD: A task force of six international experts reviewed the original guidelines proposed by the International Test Commission, taking into account the advances and developments of the field. RESULTS: As a result of the revision this new edition consists of twenty guidelines grouped into six sections: Precondition, test development, confirmation, administration, score scales and interpretation, and document. The different sections are reviewed, and the possible sources of error influencing the tests translation and adaptation analyzed. CONCLUSIONS: Twenty guidelines are proposed for translating and adapting tests across cultures. Finally we discuss the future perspectives of the guidelines in relation to the new developments in the field of psychological and educational assessment.

[Differential and modulator effect of body mass index on body dissatisfaction in two groups of Spanish and Mexicans young women]. / Efecto diferencial y modulador del índice de masa corporal sobre la insatisfacción corporal en mujeres jóvenes españolas y mexicanas.

INTRODUCTION: The high prevalence of body dissatisfaction among young women from developed countries is studied as a predictive factor, among others, of restrictive nutritional and feeding attitudes. Cultural and biological factors, such as body mass index and puberty, stand out as the most commonly studied variables in relation tobody dissatisfaction. OBJECTIVES: To analyze the differential effect of body mass index on body dissatisfaction (BD) and its modulating effect in two different cultures, the Spanish and Mexican cultures. To look deeper into the evolution of body dissatisfaction according to age. METHODOLOGY: BMI and body dissatisfaction, measured with a 10-item scale, were studied in a big sample of young Spanish (N = 950) and Mexicans (N = 531) women, aged 15-21 years. The analyses were carried out according to the general linear model. RESULTS AND DISCUSSION: A differential effect of BMI on BD was observed for the Mexican and the Spanish populations. The estimated regression line for the Spanish population is steeper, which reflects a greater effect of the BMI indexes on BD in this population. In both samples a decreasing pattern of BD levels was observed according to age and a modulating effect of BMI. CONCLUSION: To properly study the effect of several factors on BD it is important to include the BMI as a modulating variable. Its effect is significant and differential depending on the culture. Its inclusion or exclusion in studies concerning BD may significantly impair the results of any investigation.

Introducción: La alta prevalencia de la insatisfacción corporal en mujeres jóvenes en los países desarrollados es objeto de estudio por su carácter predictor entre otros, de conductas nutricionales y alimentarias restrictivas. Entre las variables más estudiadas con relación a la insatisfacción corporal destacan factores culturales y biológicos como el índice de masa corporal y la pubertad. Objetivos: Analizar el efecto diferencial del Índice de Masa Corporal sobre la Insatisfacción Corporal y su efecto modulador en dos culturas diferentes, España y México. Profundizar en la evolución de la Insatisfacción corporal en función de la edad. Metodología: Utilizando una muestra amplia de mujeres jóvenes españolas (N= 950) y mexicanas (N=531) con edades comprendidas entre los 15 y 21 años, se midieron el IMC, y la insatisfacción corporal con una escala de 10 ítems. Los análisis se efectuaron dentro del modelo lineal general. Resultados y discusión: Se constata un efecto diferencial del IMC sobre la IC para la población mexicana y la población española. La recta de regresión estimada en esta última posee una pendiente más pronunciada, reflejo de un mayor efecto de los niveles de IMC sobre la IC en la muestra española. Se encontró en ambas muestras un patrón descendente en los niveles de IC en función de la edad y un efecto modulador del IMC. Conclusión. Para un correcto estudio del efecto de distintos factores sobre la IC es importante incluir el IMC como variable moduladora. Su efecto es significativo y diferencial en función de la cultura. Su inclusión o exclusión en los estudios sobre IC puede afectar significantemente los resultados de cualquier investigación.

Changes in body dissatisfaction relative to gender and age: the modulating character of BMI.

This study examines the level of body satisfaction in adolescents, and its association with age, sex and body mass index. A non-clinical group was made up of 935 adolescents (484 boys and 451 girls), aged between 10 and 18 years. The body image was assessed by the Body Dissatisfaction scale within the Eating Disorder Inventory (Garner, 1998, 2004) and by the indirect indicator Ideal Body Mass Index. The results showed that the Body Mass Index is an important covariable in the study of body dissatisfaction. Body dissatisfaction mean values increased in the female sample. The males' values did not change throughout adolescence.

[A measure of team cohesion in sport. Spanish adaptation of Group Environment Questionnaire (GEQ)]. / Medida de la cohesión en equipos deportivos. Adaptación al español del Group Environment Questionnaire (GEQ).

The aim of this work was to adapt the Group Environment Questionnaire (GEQ) to Spanish. Judgmental procedures were used to assess the linguistic and cultural equivalence of the versions. Psychometric procedures were used in the operational phase of the study. The normative sample comprised 924 sportsmen/sportswomen from 75 teams. The GEQ scale showed suitable indexes of internal consistency and a bidimensional structure based on two factors of the cohesion model, the Task component and the Social component. In addition, a positive relation between team-performance and the Task component of team cohesion was observed. Overall, the results supported the Spanish version of the GEQ.

[Subjective values of quality-of-life dimensions in the elderly]. / Valores subjetivos de las dimensiones de calidad de vida en adultos mayores.

OBJECTIVE: The present study analyzes the subjective importance of five quality-of-life dimensions among non-institutionalized elderly people (>65 years old). MATERIAL AND METHODS: A Thurstonian design for paired comparisons was used to estimate subjective values for five quality-of-life dimensions (health, autonomy, housing, family and social support networks, and social activities) in a sample of 404 persons (168 men and 234 women) aged 65-94 years old. RESULTS: The most important dimension was health, which was given the highest subjective value, followed by personal autonomy. The third most important dimensions were housing adapted to age-related needs and support networks, with practically equivalent values. The least important dimension was social activities. CONCLUSIONS: Significant differences between genders were detected in educational level and income, but the rank order of the dimensions and the subjective values assigned to them were equivalent for men and women.

[Application of four procedures for detecting differential item functioning in polytomous items]. / Aplicación de cuatro procedimientos de detección del funcionamiento diferencial sobre ítems politómicos.

The authors describe and use four methods for detecting Differential Item Functioning in polytomous items: Mantel, Generalized Mantel-Haenszel (GMH), Ordinal Logistic Regression (RLO), and Discriminant Logistic Regression (RLD). For each procedure, the theoretical model and the measure of effect size are described. The data from the "Reading Comprehension Test" from the PISA2000 evaluation program were analyzed using a cross-validation design. Two booklets were independently evaluated in the American and Spanish samples. Adopting as decision rule the significance of the statistical test and the measurement of the effect size, agreement among the evaluated procedures was total for two of the analyzed items.