RESUMO
BACKGROUND: Low-stakes tests are becoming increasingly important in international assessments of educational progress, and the validity of these results is essential especially as these results are often used for benchmarking. Test scores in these tests not only mirror students' ability but also depend on their test-taking effort. One way to obtain more valid scores from participating samples is to identify test-takers with low test-taking effort and to exclude them from further analyses. Self-assessment is a convenient and quick way of measuring test-taking effort. We present the newly developed Test-taking Effort Short Scale (TESS), which comprises three items measuring attainment value/intrinsic value, utility value, and perceived benefits, respectively. METHODS: In a multicenter validation study with N = 1837 medical students sitting a low-stakes progress test we analyzed item and test statistics including construct and external validity. RESULTS: TESS showed very good psychometric properties. We propose an approach using stanine norms to determine a cutoff value for identifying participants with low test-taking effort. CONCLUSION: With just three items, TESS is shorter than most established self-assessment scales; it is thus suited for administration after low-stakes progress testing. However, further studies are necessary to establish its suitability for routine usage in assessment outside progress testing.
Assuntos
Estudantes de Medicina , Habilidades para Realização de Testes/psicologia , Adolescente , Adulto , Benchmarking , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Percepção , Psicometria , Reprodutibilidade dos Testes , Autoavaliação (Psicologia) , Inquéritos e Questionários , Habilidades para Realização de Testes/normas , Adulto JovemRESUMO
Digitisation in the education of future doctors was still in its infancy before the Covid pandemic. For the successful implementation of digital teaching, students need the technical equipment and the necessary skills to use it in a meaningful way. Furthermore, it requires a willingness to adapt the learning environment and to take responsibility for self-directed learning. At the beginning of 2020, faculties were forced to convert all teaching to digital formats. Initial research shows that students prefer face-to-face teaching. To determine whether medical students were prepared for digital studies and what should be considered for the future, we analysed surveys at the beginning of online studies and after two Corona semesters at a medical faculty. We were able to show that although our students had good technology equipment, they had a rather negative attitude towards online teaching for various reasons and developed negative emotions. Deficits in design of educational material, and personal learning habits raised concern. A lack of guidance and a lack of interaction with fellow students contributed to this. Adjustments in these areas will be necessary in the future to provide students with positive access to digital studies and thus increase learning success.
RESUMO
Introduction: Routine medical care in Germany, Austria and Switzerland is being increasingly impacted by the cultural and linguistic diversity of an ever more complex world. Both at home and as part of international student exchanges, medical students are confronted with different ways of thinking and acting in relation to health and disease. Despite an increasing number of courses on cultural competence and global health at German-speaking medical schools, systematic approaches are lacking on how to integrate this topic into medical curricula. Methodological approach: This paper is based on a structured consensus-building process by a multidisciplinary committee composed of faculty and students. In a first step, a qualitative online survey was carried out in order to establish an inventory of definitions and concepts. After the second step, in which a literature search was conducted and definitions of global health and transcultural and intercultural competence were clarified, recommendations were formulated regarding content, teaching and institutional infrastructure. Based on small-group work and large-group discussions, different perspectives and critical issues were compiled using multiple feedback loops that served to ensure quality. Results: An inventory on the national and international level showed that great heterogeneity exists in regard to definitions, teaching strategies, teaching formats and faculty qualification. Definitions and central aspects considered essential to medical education were thus established for the use of the terms "cultural competence" and "global health". Recommendations are given for implementation, ranging from practical realization to qualification of teaching staff and education research. Outlook: High-quality healthcare as a goal calls for the systematic internationalization of undergraduate medical education. In addition to offering specific courses on cultural competence and global health, synergies would be created through the integration of cultural competence and global health content into the curricula of already existing subject areas. The NKLM (the national competence-based catalogue of learning objectives for undergraduate medical education) would serve as a basis for this.