Embodied teacher identity: a qualitative study on 'practical sense' as a basic pedagogical condition in times of Covid-19.

Worldwide, the Covid-19 pandemic has transformed teaching contexts rapidly. Studies on the effects of the Covid-19 pandemic have largely focused on students' learning and well-being. In contrast, little is known about how emergency online teaching affects teachers. The aim of this study was to examine how disrupted teaching contexts during the Covid-19 pandemic affected academic teacher identities in health science education. Interviews were conducted with 19 experienced lecturers in health science education from two universities. Interview data were analysed using systematic text condensation. The established codes were compared across interviews to identify common themes and subsequently synthesized into descriptions of the emerging phenomena. Findings indicated that a form of embodied teacher identity, i.e. internalized teaching practices turned into dispositions, constituted a basic pedagogical condition and a resource for the teachers, and that the sudden change in the teaching context caused a loss of teacher identity. This identity loss was related to an incorporated understanding and use of the teacher's sense of the classroom (subtheme 1), non-verbal feedback from students (subtheme 2) and reciprocal visual contact (subtheme 3). Data also indicated that teachers' ability to adapt their teaching to students' needs while teaching and teachers' motivation and job satisfaction may have suffered. Universities should carefully consider how to cultivate sustainable and adaptive teacher identities compatible with the increasing digitalization of learning environments. Teaching is an embodied affair, and teacher identities are sensitive to structural changes in teaching contexts.

How to play the game of medical education: Sociocultural analyses of educational difficulties among medical residents.

This article was migrated. The article was marked as recommended. Medical residents in difficulty struggle to comply with educational requirements. They pose a liability to patient safety and they have problems to adapt to the professional role of a doctor. Consequently, being a resident in difficulty may cause identity crisis and have the potential to disrupt the resident's professional identity as a doctor. Only few studies explore the tipping point between becoming a resident in difficulty or not, and these studies rarely reflect the surrounding sociocultural aspects of the residents' difficulties such as organisational culture in the workplace. This article explores how medical residency training culture influence on residents' risk of ending in difficulty. Our study was based on six focus-group interviews with residents (n=28) and in-depth interviews with residents in difficulty (n=10). The interpretation of data employed sociologist Pierre Bourdieu's theoretical framework around dispositions. Across the data, we identified four themes: Conflicting games in the field of medical education, altruism, organisational hierarchy, and coping with stress. We found a (mis)match between legitimate rules in the field of medicine and the residents' dispositions to appreciate those rules. These results can inform clinical supervisors and consultants in their decisions for supporting residents in difficulty and increasing educational achievement among struggling residents.

Qualitative analysis of MMI raters' scorings of medical school candidates: A matter of taste?

Recent years have seen leading medical educationalists repeatedly call for a paradigm shift in the way we view, value and use subjectivity in assessment. The argument is that subjective expert raters generally bring desired quality, not just noise, to performance evaluations. While several reviews document the psychometric qualities of the Multiple Mini-Interview (MMI), we currently lack qualitative studies examining what we can learn from MMI raters' subjectivity. The present qualitative study therefore investigates rater subjectivity or taste in MMI selection interview. Taste (Bourdieu 1984) is a practical sense, which makes it possible at a pre-reflective level to apply 'invisible' or 'tacit' categories of perception for distinguishing between good and bad. The study draws on data from explorative in-depth interviews with 12 purposefully selected MMI raters. We find that MMI raters spontaneously applied subjective criteria-their taste-enabling them to assess the candidates' interpersonal attributes and to predict the candidates' potential. In addition, MMI raters seemed to share a taste for certain qualities in the candidates (e.g. reflectivity, resilience, empathy, contact, alikeness, 'the good colleague'); hence, taste may be the result of an ongoing enculturation in medical education and healthcare systems. This study suggests that taste is an inevitable condition in the assessment of students' performance. The MMI set-up should therefore make room for MMI raters' taste and their connoisseurship, i.e. their ability to taste, to improve the quality of their assessment of medical school candidates.

The Danish Neck Disability Index: New Insights into Factor Structure, Generalizability, and Responsiveness.

OBJECTIVE: To (1) translate and culturally adapt and (2) determine the clinimetric properties of the Danish 8-item Neck Disability Index (NDI-8) in primary sector patients (PSPs) and secondary sector patients (SSPs). METHODS: Analyses included 326 patients with neck pain. Validity and reliability were assessed using a cross-validation factor analytical design, hypothesis testing, internal consistency, measurement error, the smallest detectable change (SDC), and a generalizability study. Criterion and construct responsiveness, minimal important change (MIC), and floor and ceiling effects were determined. RESULTS: The original Danish version of the NDI was not unidimensional. Omitting 2 items (pain, headache) revealed a 1-factor structure (NDI-8). Construct validity correctly predicted 88% of the hypotheses. Internal consistency (Cronbach's α) ranged between 0.88 and 0.89, and generalizability was high (Φ = 0.90). The SDC was 6.8 in PSPs and 5.9 in SSPs. Criterion responsiveness revealed poor areas under the curve for SSPs (0.58 to 0.64), and construct responsiveness was poor for PSPs (43% correctly predicted hypothesis). A floor effect of 26.5% was found in PSPs, with a change of 4 points representing the MIC. CONCLUSION: The modified Danish 8-item NDI was unidimensional, had construct validity, and was reproducible with a large but acceptable measurement error. However, responsiveness was poor and a significant floor effect was found in PSPs. A change score representing the MIC is proposed for PSPs.

The validity of student tutors' judgments in early detection of struggling in medical school. A prospective cohort study.

Early identification and support of strugglers in medical education is generally recommended in the research literature, though very little evidence of the diagnostic qualities of early teacher judgments in medical education currently exists. The aim of this study was to examine the validity of early diagnosis of struggling in medical school based on informal teacher judgements of in-class behavior. The study design was a prospective cohort study and the outcomes/truth criteria were anatomy failure and medical school drop out. Six weeks into an anatomy course, student tutors attempted to identify medical students, who they reckoned would fail the anatomy course or drop out, based on their everyday experiences with students in a large group educational setting. In addition, they were asked to describe the indicators of struggling they observed. Sixteen student tutors evaluated 429 medical students for signs of struggling. By week six, the student tutors were able to detect approximately 1/4-1/3 of the students who eventually failed or dropped out, and for ¾ of the strugglers they identified, they were correct in their judgments. Informal student tutor's judgements showed incremental validity for both outcomes when controlling for grades obtained in preceeding exams. Lack of participation, lack of commitment, poor academic performance, poor social interactions and general signs of distress were the main indicators of struggling identified. Teachers' informal judgements of in-class behavior may be an untapped source of information in the early identification of struggling medical students with added value above and beyond formal testing.

Residents in difficulty: a mixed methods study on the prevalence, characteristics, and sociocultural challenges from the perspective of residency program directors.

BACKGROUND: The majority of studies on prevalence and characteristics of residents in difficulty have been conducted in English-speaking countries and the existing literature may not reflect the prevalence and characteristics of residents in difficulty in other parts of the world such as the Scandinavian countries, where healthcare systems are slightly different. The aim of this study was to examine prevalence and characteristics of residents in difficulty in one out of three postgraduate medical training regions in Denmark, and to produce both a quantifiable overview and in-depth understanding of the topic. METHODS: We performed a mixed methods study. All regional residency program directors (N = 157) were invited to participate in an e-survey about residents in difficulty. Survey data were combined with database data on demographical characteristics of the background population (N = 2399) of residents, and analyzed statistically (Chi-squared test (Χ (2)) or Fisher's exact test). Secondly, we performed a qualitative interview study involving three focus group interviews with residency program directors. The analysis of the interview data employed qualitative content analysis. RESULTS: 73.2 % of the residency program directors completed the e-survey and 22 participated in the focus group interviews. The prevalence of residents in difficulty was 6.8 %. We found no statistically significant differences in the prevalence of residents in difficulty by gender and type of specialty. The results also showed two important themes related to the workplace culture of the resident in difficulty: 1) belated and inconsistent feedback on the resident's inadequate performance, and 2) the perceived culturally rooted priority of efficient patient care before education in the workplace. These two themes were emphasized by the program directors as the primary underlying causes of the residents' difficulty. CONCLUSIONS: More work is needed in order to clarify the link between, on the one hand, observable markers of residents in difficulty and, on the other hand, immanent processes and logics of practice in a healthcare system. From our perspective, further sociological and pedagogical investigations in educational cultures across settings and specialties could inform our understanding of and knowledge about pitfalls in residents' and doctors' socialization into the healthcare system.

Improving QST Reliability--More Raters, Tests, or Occasions? A Multivariate Generalizability Study.

UNLABELLED: The reliability of quantitative sensory testing (QST) is affected by the error attributable to both test occasion and rater (examiner) and the interactions between them. Most reliability studies account for only 1 source of error. The present study employed a fully crossed, multivariate generalizability design to account for rater and occasion variance simultaneously. Nineteen healthy volunteers were examined with a battery of 7 QST procedures 4 times on 2 occasions by 2 raters. The QST battery was composed to include a mix of different pain stimuli and response domains, including threshold, intensity, tolerance, and modulation with mechanical, thermal, and chemical stimuli. The classical test-retest and interrater reliability (.19 < intraclass correlation coefficient <.92) was in line with the literature, and generalizability analysis indicated that the universe score was generally the dominant source of variation (relative contribution = 19%, 78%). Error attributable to the interaction between study participant and occasion was also influential. Dependability coefficients indicated that a substantial increase in reliability and feasibility could be achieved by employing a composite QST battery compared to single QST procedures. Reliability was improved more by repeated testing on separate occasions than by repeated testing by different raters. PERSPECTIVES: When balancing reliability and feasibility, the current findings suggest that a carefully selected battery of QST procedures repeated on a few occasions may be optimal.

Clinical assessment of transthoracic echocardiography skills: a generalizability study.

BACKGROUND: Transthoracic echocardiography (TTE) is a widely used cardiac imaging technique that all cardiologists should be able to perform competently. Traditionally, TTE competence has been assessed by unstructured observation or in test situations separated from daily clinical practice. An instrument for assessment of clinical TTE technical proficiency including a global rating score and a checklist score has previously shown reliability and validity in a standardised setting. As clinical test situations typically have several sources of error giving rise to variance in scores, a more thorough examination of the generalizability of the assessment instrument is needed. METHODS: Nine physicians performed a TTE scan on the same three patients. Then, two raters rated all 27 TTE scans using the TTE technical assessment instrument in a fully crossed, all random generalizability study. Estimated variance components were calculated for both the global rating and checklist scores. Finally, dependability (phi) coefficients were also calculated for both outcomes in a decision study. RESULTS: For global rating scores, 66.6% of score variance can be ascribed to true differences in performance. For checklist scores this was 88.8%. The difference was primarily due to physician-rater interaction. Four random cases rated by one random rater resulted in a phi value of 0.81 for global ratings and two random cases rated by one random rater showed a phi value of 0.92 for checklist scores. CONCLUSIONS: Using the TTE checklist as opposed to the TTE global rating score had the effect of minimising the largest source of error variance in test scores. Two cases rated by one rater using the TTE checklist are sufficiently reliable for high stakes examinations. As global rating is less time consuming it could be considered performing four global rating assessments in addition to the checklist assessments to account for both reliability and content validity of the assessment.

A validation study of the psychometric properties of the Groningen Reflection Ability Scale.

BACKGROUND: Reflection, the ability to examine critically one's own learning and functioning, is considered important for 'the good doctor'. The Groningen Reflection Ability Scale (GRAS) is an instrument measuring student reflection, which has not yet been validated beyond the original Dutch study. The aim of this study was to adapt GRAS for use in a Danish setting and to investigate the psychometric properties of GRAS-DK. METHODS: We performed a cross-cultural adaptation of GRAS from Dutch to Danish. Next, we collected primary data online, performed a retest, analysed data descriptively, estimated measurement error, performed an exploratory and a confirmatory factor analysis to test the proposed three-factor structure. RESULTS: 361 (69%) of 523 invited students completed GRAS-DK. Their mean score was 88 (SD = 11.42; scale maximum 115). Scores were approximately normally distributed. Measurement error and test-retest score differences were acceptable, apart from a few extreme outliers. However, the confirmatory factor analysis did not replicate the original three-factor model and neither could a one-dimensional structure be confirmed. CONCLUSIONS: GRAS is already in use, however we advise that use of GRAS-DK for effect measurements and group comparison awaits further review and validation studies. Our negative finding might be explained by a weak conceptualisation of personal reflection.

Residents in difficulty--just slower learners? A case-control study.

BACKGROUND: Recent meta-analyses have found small-moderate positive associations between general performance in medical school and postgraduate medical education. In addition, a couple of studies have found an association between poor performance in medical school and disciplinary action against practicing doctors. The aim of this study was to examine if a sample of Danish residents in difficulty tended to struggle already in medical school, and to determine whether administratively observable performance indicators in medical school could predict difficulties in residency. METHODS: The study design was a cumulative incidence matched case-control study. The source population was all active specialist trainees, who were medical school graduates from Aarhus University, in 2010 to June 2013 in two Danish regions. Cases were doctors who decelerated, transferred, or dropped out of residency. Cases and controls were matched for graduation year. Medical school exam failures, grades, completion time, and academic dispensations as predictors of case status were examined with conditional logistic regression. RESULTS: In total 89 cases and 343 controls were identified. The total number of medical school re-examinations and the time it took to complete medical school were significant individual predictors of subsequent difficulties (deceleration, transferral or dropout) in residency whereas average medical school grades were not. CONCLUSIONS: Residents in difficulty eventually reached similar competence levels as controls during medical school; however, they needed more exam attempts and longer time to complete their studies, and so seemed to be slower learners. A change from "fixed-length variable-outcome programmes" to "fixed-outcome variable-length programmes" has been proposed as a way of dealing with the fact that not all learners reach the same level of competence for all activities at exactly the same time. This study seems to support the logic of such an approach to these residents in difficulty.

Admission criteria and diversity in medical school.

CONTEXT: The under-representation in medical education of students from lower socio-economic backgrounds is an important social issue. There is currently little evidence about whether changes in admission strategies might increase the diversity of the medical student population. Denmark introduced an 'attribute-based' admission track to make it easier for students who may not be eligible for admission on the 'grade-based' track to be admitted on the basis of attributes other than academic performance. The aim of this research was to examine whether there were significant differences in the social composition of student cohorts admitted via each of the two tracks during the years 2002-2007. METHODS: This prospective cohort study included 1074 medical students admitted during 2002-2007 to the University of Southern Denmark medical school. Of these, 454 were admitted by grade-based selection and 620 were selected on attributes other than grades. To explore the social mix of candidates admitted on each of the two tracks, respectively, we obtained information on social indices associated with educational attainment in Denmark (ethnic origin, father's education, mother's education, parenthood, parents living together, parent in receipt of social benefits). RESULTS: Selection strategy (grade-based or attribute-based) had no statistically significant effect on the social diversity of the medical student population. CONCLUSIONS: The choice of admission criteria may not be very important to widening access and increasing social diversity in medical schools. Attracting a sufficiently diverse applicant pool may represent a better strategy for increasing diversity in the student population.

Selected determinants may account for dropout risks among medical students.

INTRODUCTION: The dropout level from the Danish medical schools is high, but we have only little insight into this problem. The purpose of this study was to qualify the ongoing discussions concerning dropout. MATERIAL AND METHODS: In this retrospective cohort study, relevant variables were extracted from the established database of Aarhus University for the 639 students initiating medicine studies between 1 January 1999 and 31 December 2000. A multivariate pre-admission and post-admission model was examined. RESULTS: Of the 639 medical students, 20% dropped out. Most students dropped out during their first year. The type of admission exam was a strong predictor of dropout in the pre-admission model, whereas previous higher education protected against dropout. Obtaining leave was a very strong predictor of dropout in the post-admission model, whereas high grades protected against dropout. CONCLUSION: The dropout rate has been decreasing during the past decade. Young people considering studying medicine could be advised to choose natural science subjects in high school, and a number of research questions concerning preparedness for medical school are worth pursuing. Leave or very low grades during the first and second study years might serve as red flags to supervisors. FUNDING: Study research was funded by Aarhus University. TRIAL REGISTRATION: Not relevant, register-based research with no biological human material cannot be notified to the Danish Committee System. The Danish Data Protection Agency allows schools to conduct anonymized, non-sensitive, educational analyses without notification.

[Admission tests for medical education]. / Optagelsesprøver på medicinstudiet.

This state of the art article explores what is known from the international and Danish literature on admission criteria as predictors of success in medical education. Previous academic performance is the best known predictor of medical students' grades. Poorer entry qualifications, broadly defined, are associated with dropout in medical education. Admission interviews may have a small additive explanatory effect on medical students' grades, but the effect on dropout has barely been investigated. Admission interviews are a challenge for the feasibility, reliability and validity of medical student selection. Admission variables in use should be supported by predictive validity.

Medical school dropout--testing at admission versus selection by highest grades as predictors.

CONTEXT: Very few studies have reported on the effect of admission tests on medical school dropout. The main aim of this study was to evaluate the predictive validity of non-grade-based admission testing versus grade-based admission relative to subsequent dropout. METHODS: This prospective cohort study followed six cohorts of medical students admitted to the medical school at the University of Southern Denmark during 2002-2007 (n=1544). Half of the students were admitted based on their prior achievement of highest grades (Strategy 1) and the other half took a composite non-grade-based admission test (Strategy 2). Educational as well as social predictor variables (doctor-parent, origin, parenthood, parents living together, parent on benefit, university-educated parents) were also examined. The outcome of interest was students' dropout status at 2 years after admission. Multivariate logistic regression analysis was used to model dropout. RESULTS: Strategy 2 (admission test) students had a lower relative risk for dropping out of medical school within 2 years of admission (odds ratio 0.56, 95% confidence interval 0.39-0.80). Only the admission strategy, the type of qualifying examination and the priority given to the programme on the national application forms contributed significantly to the dropout model. Social variables did not predict dropout and neither did Strategy 2 admission test scores. CONCLUSIONS: Selection by admission testing appeared to have an independent, protective effect on dropout in this setting.

Factors associated with dropout in medical education: a literature review.

CONTEXT: Medical school dropout may have negative consequences for society, patients, the profession, schools and dropouts. To our knowledge, the literature dealing with dropout from medical school has never been systematically and critically appraised. OBJECTIVES: This review aimed to systematically and critically review studies dealing with factors found to be associated with dropping out of medical school. METHODS: A systematic critical literature review of the international peer-reviewed research literature on medical education was performed. A primary search was conducted and subsequently supplemented with ancestry and descendancy searches. The population of interest was medical students and the outcome was dropout. Abstract/title screening and quality assessment were performed by two independent researchers. Studies were assessed on six domains of quality: study participation; study attrition; predictor measurement; measurement of and accounting for confounders; outcome measurement, and analysis. Only studies that accounted for confounding were included in the final analysis. RESULTS: Of 625 studies found, 48 were quality-assessed and 13 of these were eventually included based on their fulfilment of our quality-related criteria. A range of entry qualifications seemed to be associated with greater chances of a student dropping out (odds ratio [OR] = 1.65-4.00). Struggling academically in medical school may be strongly associated with dropout. By contrast, no specific pattern of demographic variables was particularly important in relation to dropout. The effects of socio-economic, psychological and educational variables on dropout were not well investigated. CONCLUSIONS: More research into causal models and theory testing, which considers the effects of education, organisation and institution, is necessary if we are to learn more about how we can actively prevent medical student withdrawal.

Generalizability of a composite student selection procedure at a university-based chiropractic program.

PURPOSE: Non-cognitive admission criteria are typically used in chiropractic student selection to supplement grades. The reliability of non-cognitive student admission criteria in chiropractic education has not previously been examined. In addition, very few studies have examined the overall test generalizability of composites of non-cognitive admission variables in admission to health science programs. The aim of this study was to estimate the generalizability of a composite selection to a chiropractic program, consisting of: application form information, a written motivational essay, a common knowledge test, and an admission interview. METHODS: Data from 105 Chiropractic applicants from the 2007 admission at the University of Southern Denmark were available for analysis. Each admission parameter was double scored using two random, blinded, and independent raters. Variance components for applicant, rater and residual effects were estimated for a mixed model with the restricted maximum likelihood method. The reliability of obtained applicant ranks (generalizability coefficients) was calculated for the individual admission criteria and for the composite admission procedure. RESULTS: Very good generalizability was found for the common knowledge test (G=1.00) and the admission interview (G=0.88). Good generalizability was found for application form information (G=0.75) and moderate generalizability (G=0.50) for the written motivation essay. The generalizability of the final composite admission procedure, which was a weighted composite of all 4 admission variables was good (G(c) = 0.80). CONCLUSION: Good generalizability for a composite admission to a chiropractic program was found. Optimal weighting and adequate sampling are important for obtaining optimal generalizability. Limitations and suggestions for future research are discussed.

Generalisability of a composite student selection programme.

UNLABELLED: OBJECTIVES The reliability of individual non-cognitive admission criteria in medical education is controversial. Nonetheless, non-cognitive admission criteria appear to be widely used in selection to medicine to supplement the grades of qualifying examinations. However, very few studies have examined the overall test generalisability of composites of non-cognitive admission variables in medical education. We examined the generalisability of a composite process for selection to medicine, consisting of four variables: qualifications (application form information); written motivation (in essay format); general knowledge (multiple-choice test), and a semi-structured admission interview. The aim of this study was to estimate the generalisability of a composite selection. METHODS: Data from 307 applicants who participated in the admission to medicine in 2007 were available for analysis. Each admission parameter was double-scored using two random, blinded and independent raters. Variance components for applicant, rater and residual effects were estimated for a mixed model with the restricted maximum likelihood (REML) method. The reliability of obtained applicant ranks (G coefficients) was calculated for individual admission criteria and for composite admission procedures. RESULTS: A pre-selection procedure combining qualification and motivation scores showed insufficient generalisability (G = 0.45). The written motivation in particular, displayed low generalisability (G = 0.10). Good generalisability was found for the admission interview (G = 0.86), and for the final composite selection procedure (G = 0.82). CONCLUSIONS: This study revealed good generalisability of a composite selection, but indicated that the application, composition and weighting of individual admission variables should not be random. Knowledge of variance components and generalisability of individual admission variables permits evidence-based decisions on optimal selection strategies.