Neuropsychological application of the International Test Commission Guidelines for Translation and Adapting of Tests.

OBJECTIVE: The number of test translations and adaptations has risen exponentially over the last two decades, and these processes are now becoming a common practice. The International Test Commission (ITC) Guidelines for Translating and Adapting Tests (Second Edition, 2017) offer principles and practices to ensure the quality of translated and adapted tests. However, they are not specific to the cognitive processes examined with clinical neuropsychological measures. The aim of this publication is to provide a specialized set of recommendations for guiding neuropsychological test translation and adaptation procedures. METHODS: The International Neuropsychological Society's Cultural Neuropsychology Special Interest Group established a working group tasked with extending the ITC guidelines to offer specialized recommendations for translating/adapting neuropsychological tests. The neuropsychological application of the ITC guidelines was formulated by authors representing over ten nations, drawing upon literature concerning neuropsychological test translation, adaptation, and development, as well as their own expertise and consulting colleagues experienced in this field. RESULTS: A summary of neuropsychological-specific commentary regarding the ITC test translation and adaptation guidelines is presented. Additionally, examples of applying these recommendations across a broad range of criteria are provided to aid test developers in attaining valid and reliable outcomes. CONCLUSIONS: Establishing specific neuropsychological test translation and adaptation guidelines is critical to ensure that such processes produce reliable and valid psychometric measures. Given the rapid global growth experienced in neuropsychology over the last two decades, the recommendations may assist researchers and practitioners in carrying out such endeavors.

The prediction limits of the National Adult Reading Test and its abbreviated and international variants.

OBJECTIVE: Premorbid tests estimate cognitive ability prior to neurological condition onset or brain injury. Tests requiring oral pronunciation of visually presented irregular words, such as the National Adult Reading Test (NART), are commonly used due to robust evidence that word familiarity is well-preserved across a range of neurological conditions and correlates highly with intelligence. Our aim is to examine the prediction limits of NART variants to assess their ability to accurately estimate premorbid IQ. METHOD: We examine the prediction limits of 13 NART variants, calculate which IQ classification system categories are reachable in principle, and consider the proportion of the adult population in the target country falling outside the predictable range. RESULTS: Many NART variants cannot reach higher or lower IQ categories due to floor/ceiling effects and inherent limitations of linear regression (used to convert scores to predicted IQ), restricting clinical accuracy in evaluating premorbid ability (and thus the magnitude of impairment). For some variants this represents a sizeable proportion of the target population. CONCLUSIONS: Since both higher and lower IQ categories are unreachable in principle, we suggest that future NART variants consider polynomial or broken-stick fitting (or similar methods) and suggest that prediction limits should be routinely reported.

Development of the Arabic Inventory of Parent and Domestic Worker Attachment (A-IPDWA): A tool to assess adolescents' attachment to secondary figures.

INTRODUCTION: Adolescents' attachment security toward parental figures has been assessed in multiple cultures and languages. In some cultural contexts, the presence of a secondary parental figure is ubiquitous, though its effect on children's and adolescents' well-being has been understudied. The present study aimed to validate a culture-specific Arabic instrument of attachment security, in an adolescent sample of Qatar. Since foreign domestic workers (Khadama) play a key role as secondary caring figures in Middle Eastern countries, the new instrument included parents (i.e., mother and father) and domestic workers as providers of attachment security. METHODS: A sample of 387 adolescents (ages 12-17 years; 48.3% females) participated in the study in the 2020-2021 school term. While 286 students completed the version in modern Arabic, 101 counterparts attending international schools filled in the English version for comparison purposes. RESULTS: Confirmatory Factor Analysis for all three forms (i.e., mother, father, and domestic worker) showed the one-dimension of the Arabic tool. Optimal Tucker's Phi coefficient indicated a comparable one-factor structure of attachment security across linguistic versions. Moderate correlations (positive and negative, respectively) of attachment security towards father and mother (but not towards domestic workers) with family cohesion and family conflict dimensions of the Family Environment Scale provided evidence for the concurrent validity. DISCUSSION: Gender differences in the links between adolescents' attachment security and family conflict were observed; culturally relevant relationship family patterns are stressed. The practical implications of the Arabic Inventory of Parent and Domestic Worker Attachment (A-IPDWA) validation are discussed.

Metabolic biomarkers significantly enhance the prediction of HBV-related ACLF occurrence and outcomes.

BACKGROUND & AIMS: Acute-on-chronic liver failure (ACLF) is a clinical syndrome associated with high short-term mortality in patients with chronic liver disease. Chronic hepatitis B is the main cause of ACLF (HBV-ACLF) in China and other Asian countries. To improve disease management and survival for patients with ACLF, we aimed to discover novel biomarkers to enhance HBV-ACLF diagnosis and prognostication. METHODS: We performed a metabolomics profiling of 1,024 plasma samples collected from patients with HBV-related chronic liver disease with acute exacerbation at hospital admission in a multi-year and multi-center prospective study (367 ACLF and 657 non-ACLF). The samples were randomly separated into equal halves as a discovery set and a validation set. We identified metabolites associated with 90-day mortality in the ACLF group and the progression to ACLF within 28 days in the non-ACLF group (pre-ACLF) using statistical analysis and machine learning. We developed diagnostic algorithms in the discovery set and used these to assess the findings in the validation set. RESULTS: ACLF significantly altered the plasma metabolome, particularly in membrane lipid metabolism, steroid hormones, oxidative stress pathways, and energy metabolism. Numerous metabolites were significantly associated with 90-day mortality in the ACLF group and/or pre-ACLF in the non-ACLF group. We developed algorithms for the prediction of 90-day mortality in patients with ACLF (area under the curve 0.87 and 0.83 for the discovery set and validation set, respectively) and the diagnosis of pre-ACLF (area under the curve 0.94 and 0.88 for the discovery set and validation set, respectively). To translate our discoveries into practical clinical tests, we developed targeted assays using liquid chromatography-mass spectrometry. CONCLUSIONS: Based on novel metabolite biomarkers, we established tests for HBV-related ACLF with higher accuracy than existing methods. CLINICAL TRIAL NUMBER: NCT02457637 and NCT03641872. IMPACT AND IMPLICATIONS: Acute-on-chronic liver failure (ACLF) is a clinical syndrome associated with high short-term mortality affecting 25% of patients hospitalized with cirrhosis. Chronic hepatitis B is the main etiology of ACLF in China and other Asian counties. There is currently no effective therapy. Early diagnosis and accurate prognostication are critical for improving clinical outcomes in patients with ACLF. Based on novel metabolite biomarkers, we developed liquid chromatography-mass spectrometry tests with improved accuracy for the early diagnosis and prognostication of HBV-related ACLF. The liquid chromatography-mass spectrometry tests can be implemented in clinical labs and used by physicians to triage patients with HBV-related ACLF to ensure optimized clinical management.

Validity of the NIH toolbox cognitive battery in a healthy oldest-old 85+ sample.

OBJECTIVE: To evaluate the construct validity of the NIH Toolbox Cognitive Battery (NIH TB-CB) in the healthy oldest-old (85+ years old). METHOD: Our sample from the McKnight Brain Aging Registry consists of 179 individuals, 85 to 99 years of age, screened for memory, neurological, and psychiatric disorders. Using previous research methods on a sample of 85 + y/o adults, we conducted confirmatory factor analyses on models of NIH TB-CB and same domain standard neuropsychological measures. We hypothesized the five-factor model (Reading, Vocabulary, Memory, Working Memory, and Executive/Speed) would have the best fit, consistent with younger populations. We assessed confirmatory and discriminant validity. We also evaluated demographic and computer use predictors of NIH TB-CB composite scores. RESULTS: Findings suggest the six-factor model (Vocabulary, Reading, Memory, Working Memory, Executive, and Speed) had a better fit than alternative models. NIH TB-CB tests had good convergent and discriminant validity, though tests in the executive functioning domain had high inter-correlations with other cognitive domains. Computer use was strongly associated with higher NIH TB-CB overall and fluid cognition composite scores. CONCLUSION: The NIH TB-CB is a valid assessment for the oldest-old samples, with relatively weak validity in the domain of executive functioning. Computer use's impact on composite scores could be due to the executive demands of learning to use a tablet. Strong relationships of executive function with other cognitive domains could be due to cognitive dedifferentiation. Overall, the NIH TB-CB could be useful for testing cognition in the oldest-old and the impact of aging on cognition in older populations.

The test developer's dilemma: Evaluating the balance of feasibility and empiric performance of test development techniques for repeated written assessments.

PURPOSE: Written assessments face challenges when administered repeatedly, including resource-intensive item development and the potential for performance improvement secondary to item recall as opposed to understanding. This study examines the efficacy of three-item development techniques in addressing these challenges. METHODS: Learners at five training programs completed two 60-item repeated assessments. Items from the first test were randomized to one of three treatments for the second assessment: (1) Verbatim repetition, (2) Isomorphic changes, or (3) Total revisions. Primary outcomes were the stability of item psychometrics across test versions and evidence of item recall influencing performance as measured by the rate of items answered correctly and then incorrectly (correct-to-incorrect rate), which suggests guessing. RESULTS: Forty-six learners completed both tests. Item psychometrics were comparable across test versions. Correct-to-incorrect rates differed significantly between groups with the highest guessing rate (lowest recall effect) in the Total Revision group (0.15) and the lowest guessing rate (highest recall effect) in the Verbatim group (0.05), p = 0.01. CONCLUSIONS: Isomorphic and total revisions demonstrated superior performance in mitigating the effect of recall on repeated assessments. Given the high costs of total item revisions, there is promise in exploring isomorphic items as an efficient and effective approach to repeated written assessments.[Box: see text].

Development and validation of the facilitative interpersonal skills scale for clients.

OBJECTIVE: Psychotherapy studies have revealed that therapist characteristics are responsible for 5% to 9% of outcome variance. The therapist-facilitative interpersonal skills (FIS) have been shown to predict both alliance and outcomes, indicating that higher FIS therapists are more effective than lower FIS therapists. The current study focused on the development and validation of the FIS-client version (FIS-C) instrument, aimed at collecting the clients' perspectives on relevant therapist characteristics. METHOD: The clinical outcomes in routine evaluation-outcome measures, the session rating scale, and the FIS questionnaire-client version were filled out by psychotherapy clients. Exploratory, confirmatory factor, and test-retest analysis were conducted. RESULTS: Results indicate robust psychometric characteristics, in terms of validity (factorial, convergent, discriminant, and nomological), reliability, and sensitivity. CONCLUSION: The validation of the FIS-C represents an important contribution to clinical research and practice, namely to the field of client feedback and therapist expertise.

Italian Adaptation of the Diagnostic Adaptive Behavior Scale: Application of the Best Practices for Translating and Adapting Tests.

BACKGROUND: The presence during the developmental period of significant limitations in adaptive behavior is an essential component along with deficits in intellectual functioning for diagnosing intellectual disability. Only the Diagnostic Adaptive Behavior Scale (DABS) specifically assesses the required significant limitations in adaptive behavior. The DABS allows measuring the three adaptive behavior domains of conceptual, practical, and social skills, in individuals aged 4 to 21. This paper aims to present the process of translation/adaptation of the DABS for the Italian culture/country and describes the best practices in adapting a test across cultures/countries. METHODS: A six-step procedure was followed: (1) translation/adaptation of the original DABS into Italian; (2) consolidation of the translation/adaptation and preparation of the Preliminary Translation; (3) validation of the Preliminary Translation; (4) revision/adjustment and preparation of the Pretest Translation; (5) field-testing of the Pretest Translation; and (6) revision/ adjustment and preparation of the Final Translation of the DABS Italian version. Two different committees were involved and were composed of members with competencies in the development/adaptation of psychological tests, in the target construct (i.e., adaptive behavior), in the administration of measures assessing the target construct, in the target populations/languages (i.e., American and Italian), and in the target individuals (i.e., with deficits in adaptive behavior). Furthermore, a field-test was conducted with potential test users. RESULTS: The results of the translation/adaptation process described herein present evidence that it resulted in a valid DABS Italian version. It can be said that the final item pool best represented the substantive meaning of the original DABS items in a linguistic style that was understandable and simple while capturing behaviors that can be observed/measured in the Italian cultural context. CONCLUSIONS: Following the best practices in translating/adapting tests, we developed the DABS Italian version with evidence of psychometric properties as excellent as those of the original DABS.

Development and evaluation of safety and effectiveness of novel cancer screening tests for routine clinical use with applications to multicancer detection technologies.

Multicancer screening is a promising approach to improving the detection of preclinical disease, but current technologies have limited ability to identify precursor or early stage lesions, and approaches for developing the evidentiary chain are unclear. Frameworks to enable development and evaluation from discovery through evidence of clinical effectiveness are discussed.

Developing sero-diagnostic tests to facilitate Plasmodium vivax Serological Test-and-Treat approaches: modeling the balance between public health impact and overtreatment.

BACKGROUND: Eliminating Plasmodium vivax will require targeting the hidden liver-stage reservoir of hypnozoites. This necessitates new interventions balancing the benefit of reducing vivax transmission against the risk of over-treating some individuals with drugs which may induce haemolysis. By measuring antibodies to a panel of vivax antigens, a strategy of serological-testing-and-treatment (PvSeroTAT) can identify individuals with recent blood-stage infections who are likely to carry hypnozoites and target them for radical cure. This provides a potential solution to selectively treat the vivax reservoir with 8-aminoquinolines. METHODS: PvSeroTAT can identify likely hypnozoite carriers with ~80% sensitivity and specificity. Diagnostic test sensitivities and specificities ranging 50-100% were incorporated into a mathematical model of vivax transmission to explore how they affect the risks and benefits of different PvSeroTAT strategies involving hypnozoiticidal regimens. Risk was measured as the rate of overtreatment and benefit as reduction of community-level vivax transmission. RESULTS: Across a wide range of combinations of diagnostic sensitivity and specificity, PvSeroTAT was substantially more effective than bloodstage mass screen and treat strategies and only marginally less effective than mass drug administration. The key test characteristic determining of the benefit of PvSeroTAT strategies is diagnostic sensitivity, with higher values leading to more hypnozoite carriers effectively treated and greater reductions in vivax transmission. The key determinant of risk is diagnostic specificity: higher specificity ensures that a lower proportion of uninfected individuals are unnecessarily treated with primaquine. These relationships are maintained in both moderate and low transmission settings (qPCR prevalence 10% and 2%). Increased treatment efficacy and adherence can partially compensate for lower test performance. Multiple rounds of PvSeroTAT with a lower performing test may lead to similar or higher reductions in vivax transmission than fewer rounds with a higher performing test, albeit with higher rate of overtreatment. CONCLUSIONS: At current performance, PvSeroTAT is predicted to be a safe and efficacious option for targeting the hypnozoite reservoir towards vivax elimination. P. vivax sero-diagnostic tests should aim for both high performance and ease of use in the field. The target product profiles informing such development should thus reflect the trade-offs between impact, overtreatment, and ease of programmatic implementation.

Psychological Tests in Arabic: A Review of Methodological Practices and Recommendations for Future Use.

Mental health research among Arabic speakers is increasing, and with it the need to assess psychopathology of Arabic-speaking populations, including natives, refugees, and immigrants. However, major challenges include the unavailability of appropriate Arabic tools, and the difficulty of judging whether available tools are appropriate. Critical judgment of psychometric tools is important, because they are used for high stake decisions such as clinical outcomes and diagnoses. We identified Arabic-language tests that measure constructs related to mental illness and health, critically analyzed their methodologies, and provided broad recommendations for future research. We conducted a systematic search query using four online databases and followed step-wise exclusions. We identified 115 articles published between January 1998 and August 2019 which produced 138 Arabic tests to screen or diagnose or plan treatment for psychological disorders. More than 80% of tests were translated or adapted from English using methods that are not comparable with the latest standards. Methods of establishing validity, reliability, and equivalence, were also limited, with one quarter not reporting reliability, and the majority using only one source of validity evidence. There is much room for improvement when making decisions about translation or adaptation designs, as well as conducting and reporting psychometric evidence.

From a recombinant key antigen to an accurate, affordable serological test: Lessons learnt from COVID-19 for future pandemics.

Serological tests detect antibodies generated by infection or vaccination, and are indispensable tools along different phases of a pandemic, from early monitoring of pathogen spread up to seroepidemiological studies supporting immunization policies. This work discusses the development of an accurate and affordable COVID-19 antibody test, from production of a recombinant protein antigen up to test validation and economic analysis. We first developed a cost-effective, scalable technology to produce SARS-COV-2 spike protein and then used this antigen to develop an enzyme-linked immunosorbent assay (ELISA). A receiver operator characteristic (ROC) analysis allowed optimizing the cut-off and confirmed the high accuracy of the test: 98.6% specificity and 95% sensitivity for 11+ days after symptoms onset. We further showed that dried blood spots collected by finger pricking on simple test strips could replace conventional plasma/serum samples. A cost estimate was performed and revealed a final retail price in the range of one US dollar, reflecting the low cost of the ELISA test platform and the elimination of the need for venous blood sampling and refrigerated sample handling in clinical laboratories. The presented workflow can be completed in 4 months from first antigen expression to final test validation. It can be applied to other pathogens and in future pandemics, facilitating reliable and affordable seroepidemiological surveillance also in remote areas and in low-income countries.

Three Sources of Validation Evidence Needed to Evaluate the Quality of Generated Test Items for Medical Licensure.

Issue: Automatic item generation is a method for creating medical items using an automated, technological solution. Automatic item generation is a contemporary method that can scale the item development process for production of large numbers of new items, support building of multiple forms, and allow rapid responses to changing medical content guidelines and threats to test security. The purpose of this analysis is to describe three sources of validation evidence that are required when producing high-quality medical licensure test items to ensure evidence for valid test score inferences, using the automatic item generation methodology for test development. Evidence: Generated items are used to make inferences about examinees' medical knowledge, skills, and competencies. We present three sources of evidence required to evaluate the quality of the generated items that is necessary to ensure the generated items measure the intended knowledge, skills, and competencies. The sources of evidence we present here relate to the item definition, the item development process, and the item quality review. An item is defined as an explicit set of properties that include the parameters, constraints, and instructions used to elicit a response from the examinee. This definition allows for a critique of the input used for automatic item generation. The item development process is evaluated using a validation table, whose purpose is to support verification of the assumptions related to model specification made by the subject-matter expert. This table provides a succinct summary of the content and constraints that were used to create new items. The item quality review is used to evaluate the statistical quality of the generated items, which often focuses on the difficulty and the discrimination of the correct and incorrect options. Implications: Automatic item generation is an increasingly popular item development method. The generated items from this process must be bolstered by evidence to ensure the items measure the intended knowledge, skills, and competencies. The purpose of this analysis is to describe these sources of evidence that can be used to evaluate the quality of the generated items. The important role of medical expertise in the development and evaluation of the generated items is highlighted as a crucial requirement for producing validation evidence.

Assessing distinguishable social skills in medical admission: does construct-driven development solve validity issues of situational judgment tests?

BACKGROUND: Social skills are important for future physicians and are therefore increasingly considered in selection processes. One economic assessment method from which different social skills can be inferred are Situational Judgment Tests (SJTs) in which applicants are asked to rate behavioral responses in context-relevant situations. However, traditional SJTs have so far failed to distinctively measure specified constructs. To address this shortcoming in the medical admission context, we applied a construct-driven approach of SJT development in which test development was deductively guided by agency and communion as target constructs. METHOD: The final version of the construct-driven SJT includes 15 items per construct with three behavioral responses. Medical school applicants (N = 1527) completed the construct-driven SJT, a traditional SJT, and an aptitude test under high-stakes condition as part of their application. A subsample (N = 575) participated in a subsequent voluntary online study with self-report measures of personality and past behavior. RESULTS: The proposed two-factor structure and internal consistency of the construct-driven SJT was confirmed. Communal SJT scores were positively associated with self-reported communal personality and communal behavior, yet effects were smaller than expected. Findings for agentic SJT scores were mixed with positive small associations to self-reported agentic personality scores and agentic behavior but unexpected negative relations to communal self-reported measures. CONCLUSIONS: Results suggest that construct-driven SJTs might overcome validity limitations of traditional SJTs, although their implementation is challenging. Despite first indicators of validity, future research needs to address practical points of application in high-stakes settings, inclusion of other constructs, and especially prediction of actual behavior before the application of construct-driven SJTs for selection purposes in medical admission can be recommended.

A knowledge test on pressure injury in adult intensive care patients: Development, validation, and item analysis.

BACKGROUND: Pressure injuries are a major problem in critically ill patients, but both students' and intensive care nurses' knowledge about these injuries leaves room for improvement. As no knowledge test is currently available that focuses on pressure injuries in adult intensive care patients, we aimed to develop such tool, establish the content validity, and perform item analysis using Classical test theory. METHODS: Test development followed established multiple-choice question-writing guidelines. Content validation used a Delphi procedure including eight international experts. Item analysis (question difficulty and discrimination power, and quality of the distractors) was based on the test results of a convenience sample who completed the test online, based on ready knowledge. RESULTS: Four Delphi validation rounds resulted in a 24-item multiple-choice test within seven categories: Epidemiology, Aetiology, Prevention, Classification, Risk factors and risk assessment, Wound care, and Skin care. The content validity index was 0.96. The median score of 12 students and 38 qualified nurses was 12.5/24 (interquartile range 11-14.25; range 4-17; 52%). Least correct answers were in the categories Classification and Wound care. Item analysis revealed several knowledge gaps and misconceptions. CONCLUSIONS: The test has excellent content validity. The sample's overall score was low. Item analysis identified various training needs. Future users are recommended to further validate the test and establish its reliability, and to tailor it to their individual context and evaluation requirements.

Development and validation of film stimuli to assess empathy in the work context.

A growing body of research suggests that empathy predicts important work outcomes, yet limitations in existing measures to assess empathy have been noted. Extending past work on the assessment of empathy, this study introduces a newly developed set of emotion-eliciting film clips that can be used to assess both cognitive (emotion perception) and affective (emotional congruence and sympathy) facets of empathy in vivo. Using the relived emotions paradigm, film protagonists were instructed to think aloud about an autobiographical, emotional event from working life and relive their emotions while being videotaped. Subsequently, protagonists were asked to provide self-reports of the intensity of their emotions during retelling their event. In a first study with 128 employees, who watched the film clips and rated their own as well as the protagonists' emotions, we found that the film clips are effective in eliciting moderate levels of emotions as well as sympathy in the test taker and can be used to calculate reliable convergence scores of emotion perception and emotional congruence. Using a selected subset of six film clips, a second two-wave study with 99 employees revealed that all facet-specific measures of empathy had moderate-to-high internal consistencies and test-retest reliabilities, and correlated in expected ways with other self-report and test-based empathy tests, cognition, and demographic variables. With these films, we expand the choice of testing materials for empathy in organizational research to cover a larger array of research questions.

Integrating theory-based and data-driven methods to case conceptualization: A functional analysis approach with ecological momentary assessment.

Objective Ecological momentary assessment (EMA) and network analysis are promising empirical developments for psychotherapy research and practice, but they lack a therapeutic rationale that could guide case conceptualization and treatment planning. We developed an assessment strategy that aims to assess functional analysis with EMA. Method: The assessment strategy was applied to a series of three N-of-1 assessments in a proof-of-concept study. After selecting a personalized set of items, EMA was implemented with three measurement time points per day for a period of 30 days. The participants evaluated feasibility and acceptance. Practicing psychotherapists discussed clinical implications in a focus group. Results: The implementation of the assessment strategy seemed feasible and accepted; participants did not report any side effects. Principal component and network analyses indicated interpretable components (e.g., participant 1: hopelessness, procrastination, coping, avoidance). The focus group pointed out potentials (e.g., efficient profit of the waiting time, empowering patients) and challenges (e.g., prioritize and interpret all the information). Conclusion: The presented assessment strategy may enhance the scientific quality of case conceptualization empowering therapists' decision-making regarding treatment planning. At the same time, it is a concrete demonstration of the challenges that need to be addressed in future research.

Development of a protective mental work demands questionnaire.

OBJECTIVES: Research shows that mental demands at work affect later-life cognitive functioning and dementia risk, but systematic assessment of protective mental work demands (PMWDs) is still missing. The goal of this research was to develop a questionnaire to assess PMWDs. DESIGN: The instrument was developed in accordance with internationally recognized scientific standards comprising conceptualization, pretesting, and validation via confirmatory factor analysis (CFA), principal component analysis (PCA), and multiple regression analyses. PARTICIPANTS: We included 346 participants, 72.3% female, with an average age of 56.3 years. MEASUREMENT: Item pool, sociodemographic questions, and cognitive tests: Trail-Making Test A/B, Word List Recall, Verbal Fluency Test, Benton Visual Retention Test, Reading Minds in the Eyes Test. RESULTS: CFAs of eight existing PMWD-concepts revealed weaker fit indices than PCA of the item pool that resulted in five concepts. We computed multivariate regression analyses with all 13 PMWD-concepts as predictors of cognitive functioning. After removing PMWD-concepts that predicted less than two cognitive test scores and excluding others due to overlapping items, the final questionnaire contained four PMWD-concepts: Mental Workload (three items, Cronbach's α = .58), Verbal Demands (four, Cronbach's α = .74), Information Load (six, Cronbach's α = .83), and Extended Job Control (six, Cronbach's α = .83). CONCLUSIONS: The PMWD-Questionnaire intends to assess protective mental demands at the workplace. Information processing demands and job control make up the primary components emphasizing their relevance regarding cognitive health in old age. Long-term follow-up studies will need to validate construct validity with respect to dementia risk.

Development and psychometric testing of Reasoning Skills test for nursing student selection: An item response theory approach.

AIMS: To develop and psychometrically test the Reasoning Skills (ReSki) test assessing undergraduate nursing applicants' reasoning skills for student selection purposes. DESIGN: A methodological cross-sectional design was applied for the psychometric testing. METHODS: The ReSki test was developed as part of a wider electronic entrance examination. The ReSki test included a case followed by three question sections assessing nursing applicants' reasoning skills according to the reasoning process. Item response theory was used for psychometric testing to assess item discrimination, difficulty and pseudoguessing parameters. The ReSki test was taken by 1056 nursing applicants in six Finnish Universities of Applied Sciences (28 May 2019). RESULTS: In the development process, the expert evaluations indicated acceptable content validity. In the psychometric testing, the test reliability was supported by item variance, the theoretical structure was supported by the correlation coefficients and the applicant mean performance supported an acceptable overall test difficulty. The item response theory indicated variance between the items' difficulty and discrimination ranges. However, most of the wrong items failed at being functional distractors. CONCLUSION: The ReSki test is a new and valid objective assessment of undergraduate nursing applicants' reasoning skills. The item response theory provided item-level information that can be used for further development of the test, especially related to the revisions needed for the distractor items to achieve the desired level of difficulty. IMPACT: What problem did the study address? The assessment of nursing applicants' reasoning skills is suggested, but there is a lack of admission tools. What were the main findings? The results provided support for the reliability and validity of the ReSki test. Item response theory indicated the need for further item-level improvement. Where and on whom will the research have an impact? The results may benefit higher education institutions and researchers when developing a test and/or student selection processes.

Validation of computerized reflective function: A replication study.

Objective: The Reflective Function (RF) Scale is the original validated measure of mentalizing, applied to Adult Attachment Interview (AAI) transcripts. This study aimed to replicate the preliminary validation of Computerized RF (CRF), a computerized text analysis measure of RF.Methods: 49 women with borderline personality disorder (BPD; n = 20) and without (n = 29) completed diagnostic interviews and the AAI. AAIs were scored by certified coders using the RF Scale, and by computerized text analysis software using CRF dictionaries.Results: CRF significantly correlated with RF. The frequency of High CRF words had moderate-to-strong correlations with RF in the total sample (rs = .47), BPD group (rs = .61), and non-BPD group (rs = .41). Adding the frequency of Low CRF words to create a proportion of High and Low CRF words, and applying CRF to AAIs trimmed to include only items that "demand" RF, both produced significant, but not stronger, correlations with RF.Conclusion: CRF is an efficient alternative to the RF Scale that can estimate mentalization. Near average levels, neither RF nor CRF significantly differentiated between groups, indicating mentalizing deficits may not always be present, detectable, or defining in BPD samples. While more research is needed, CRF is a valid assessment of RF when codable text is available.