The Continuing Challenges of Studying Parallel Behaviours in Humans and Animal Models.

The use of animal models continues to be essential for carrying out research into clinical phenomena, including addiction. However, the complexity of the clinical condition inevitably means that even the best animal models are inadequate, and this may go some way to account for the apparent failures of discoveries from animal models, including the identification of potential novel therapies, to translate to the clinic. We argue here that it is overambitious and misguided in the first place to attempt to model complex, multifacetted human disorders such as addiction in animals, and especially in rodents, and that all too frequently "validity" of such models is limited to superficial similarities, referred to as "face validity", that reflect quite different underlying phenomena and biological processes from the clinical situation. Instead, a more profitable approach is to identify (a) well-defined intermediate human behavioural phenotypes that reflect defined, limited aspects of, or contributors to, the human clinical disorder, and (b) to develop animal models that are homologous with those discrete human behavioural phenotypes in terms of psychological processes, and underlying neurobiological mechanisms. Examples of past and continuing weaknesses and suggestions for more limited approaches that may allow better homology between the test animal and human condition are made.

Feasibility and face validity of two patient reported outcome measures for nausea: Preferences of children with cancer.

PURPOSE: To optimize recognition and management of nausea in children with cancer using patient reported outcome measures (PROMs) and to identify preferences of children with cancer regarding two validated tools: the Baxter Retching Faces (BARF) scale and the Pediatric Nausea Assessment Tool (PeNAT). DESIGN AND METHODS: This quantitative descriptive cross-sectional study (n = 34) used bespoke questionnaires to measure feasibility and face validity of the BARF and the PeNAT. Feasibility included the items: understanding, ease of use, and communication. Face validity was studied in terms of the degree in which the faces of both PROMs corresponded with children's feelings of nausea. A descriptive and comparative analysis of the data was performed. RESULTS: Both the BARF and the PeNAT were rated by the children as feasible, and no significant differences were found. However, regarding the item communication, the PeNAT did not reach the cut-off value (≥80% of all children scored neutral, agree or totally agree on the Likert scale). Regarding face validity, only the BARF reached the cut-off value and corresponded significantly better with children's feelings of nausea than the PeNAT. CONCLUSION: According to children with cancer, only the BARF is both feasible and meets criteria for face validity. Therefore, the BARF is recommended as a PROM for reporting nausea in children with cancer. However, possible differences between age groups should be taken into account for future research. PRACTICE IMPLICATIONS: This study will help health care professionals in making a patient-centered and informed choice when using a PROM for measuring nausea in children with cancer.

Development and content validity testing of a colonoscopy-specific patient-reported experience measure: the Patient Experience Colonoscopy Scale (PECS).

BACKGROUND: In endoscopic care, favourable patient experiences before, during and after a colonoscopy are essential for the patient's willingness to repeat the procedure. To ensure that significant experiences are measured, patients should be involved in creating the measurement instruments. Thus, the aim of the present study was to develop a colonoscopy-specific PREM by (1) operationalising patient experiences before, during and after a colonoscopy procedure and (2) evaluating its content validity. METHODS: The colonoscopy-specific PREM was developed in two stages: (1) operationalisation with item generation and (2) content validity testing. A previously developed conceptual model, based on a systematic literature review that illustrates patients' (n = 245) experiences of undergoing a colonoscopy, formed the theoretical basis. To assess the degree to which the PREM reflected patients' experiences before, during and after a colonoscopy procedure, content validity was tested-through face validity with healthcare professionals (n = 4) and cognitive interviews with patients (n = 14) having experienced a colonoscopy. Content validity index (CVI) was calculated to investigate the relevance of the items. RESULTS: The Patient Experience Colonoscopy Scale (PECS) is a colonoscopy-specific PREM consisting of five different constructs: health motivation, discomfort, information, a caring relationship and understanding. Each construct was defined and generated into a pool of items (n = 77). After face-validity assessment with healthcare professionals, a draft 52-item version of the PECS was ready for content validity testing by the patients. During cognitive interviews the patients contributed valuable insights that led to rewording and removal of items. Results from the CVI suggest that the PECS and its content are relevant (I-CVI range 0.5-1, S-CVI/Ave = 0.86). The final PECS consists of 30 items representing a colonoscopy-specific PREM. CONCLUSION: The PECS is a new 30-item PREM instrument designed for adult elective colonoscopy patients after they have undergone the procedure. Each item in the PECS derives from a conceptual model based on a systematic literature review. Patients and healthcare professionals were involved in developing the PECS, which measures colonoscopy-specific patient experiences before, during and after the procedure. The content validity testing positively contributed to the development of the PECS. Psychometric properties need to be evaluated further.

Knowledge, Awareness, and Practice of Safety and Emergency Response Among Scuba Divers in Malaysia: Questionnaire Development and Validation.

INTRODUCTION: Safety has become paramount to ensure that scuba diving continues to expand into new markets, with minimal risks, and that scuba diving translates into a safe and relaxed adventure in response to growing market demands. Research focusing on assessing the knowledge, awareness, and practices (KAP) regarding safety and emergency response among scuba divers has been limited, and there is a need for validated assessment tools in this area. METHODS: This study involved 555 scuba divers in Malaysia, and the questionnaire underwent a thorough development and validation process, including content and face validity assessments, as well as exploratory factor analysis. The validation of the knowledge domain was conducted using Item Response Theory (IRT) analysis, while awareness and practice were validated through exploratory and confirmatory factor analyses (EFA and CFA). RESULTS: The content validity of the instrument was confirmed, with all items scoring over 80% for Item Content Validity Index (I-CVI), Scale Content Validity Index (S-CVI), and Scale Content Validity Index/Average (S-CVI/AVE). The initial draft comprises three domains: knowledge, awareness, and practice. Knowledge items were analyzed using IRT and demonstrated acceptable difficulty and discrimination levels. For the awareness and practice domains, EFA showed a Kaiser-Meyer-Olkin measure (KMO) of 0.83 and 0.79, respectively, with a significant Bartlett's test of Sphericity (P < 0.001). EFA yielded three factors for both awareness and practice domains with a total of 12 items for awareness and 13 items for practice, with satisfactory factor loadings (≥0.3). The final model of CFA showed good fits for both awareness and practice domains in terms of absolute, parsimonious, and comparative measures. The composite reliability of awareness was acceptable with Raykov's rho of 0.71, whereas the practice domain fell slightly below the acceptable threshold at 0.55. This was attributed to low factor loading and a limited number of items within each factor. The final questionnaire now consists of 20 items for knowledge, 10 items for awareness, and 12 items for the practice domain. CONCLUSION: The results of this validation and reliability study indicate that the newly developed questionnaire possesses favorable psychometric properties for assessing KAP related to safety and emergency response in the scuba diving context. This research is essential for harmonizing the perspectives of crucial stakeholders within the recreational scuba diving industry.

Content and face validity of Workplace COVID-19 Knowledge & Stigma Scale (WoCKSS).

BACKGROUND: The COVID-19 pandemic has led to fear, rumours, and stigma, particularly against those infected with the virus. In Malaysia, the manufacturing industry is particularly vulnerable to COVID-19 clusters, making it critical to assess stigma attitudes among workers. To address this issue, The Workplace COVID-19 Knowledge & Stigma Scale (WoCKSS) was developed specifically for use in the manufacturing industry which served as the sample population for testing this scale. It was developed in the Malay language to ensure alignment with the local context. This study examines the content and face validity of WoCKSS, which can help assess the level of knowledge and stigma associated with COVID-19 among workers. METHODS: The WoCKSS was developed with 20 and 31 items for knowledge and stigma domains, respectively, based on an extensive review of COVID-19 literature. Content validation was conducted by four experts using a content validation form to assess the relevancy of each item to the intended construct. Content Validity Index (CVI) was calculated to measure the agreement between the experts on the relevance of each item to the intended construct. Face validation was then conducted by randomly selecting 10 respondents from the manufacturing industry, who rated the clarity and comprehension of each item using a face validation form. The Item Face Validity Index (I-FVI) was calculated to determine the clarity and comprehension of each question, and only items with an I-FVI ≥ 0.83 were retained. RESULTS: The WoCKSS achieved excellent content validity in both knowledge and stigma domains. Only 19 items from the knowledge domain and 24 items from the stigma domain were retained after CVI analysis. All retained items received a CVI score of 1.00, indicating perfect agreement among the experts. FVI analysis resulted in 17 items for the knowledge domain and 22 items for the stigma domain. The knowledge domain achieved a high level of agreement among respondents, with a mean I-FVI of 0.91 and a S-FVI/UA of 0.89. The stigma domain also showed high agreement, with a mean I-FVI of 0.99 and a S-FVI/UA of 0.86. CONCLUSION: In conclusion, the WoCKSS demonstrated high content and face validity. However, further testing on a larger sample size is required to establish its construct validity and reliability.

Chronic social defeat stress in prairie voles (Microtus ochrogaster): A preclinical model for the study of depression-related phenotypes.

BACKGROUND: Stress-induced illnesses, like major depression, are among the leading causes of disability across the world. Consequently, there is a dire need for the validation of translationally-suited animal models incorporating social stress to uncover the etiology of depression. Prairie voles (Microtus ochrogaster) are more translationally relevant than many other rodent models as they display monogamous social and bi-parental behaviors. Therefore, we evaluated whether a novel social defeat stress (SDS) model in male prairie voles induces depression-relevant behavioral outcomes. METHODS: Adult sexually-naïve male prairie voles experienced SDS bouts from a conspecific pair-bonded male aggressor, 10 min per day for 10 consecutive days. Non-stressed controls (same-sex siblings) were housed in similar conditions but never experienced physical stress. Twenty-four h later, voles were evaluated in social interaction, sucrose preference, and Morris water maze tests - behavioral endpoints validated to assess social withdrawal, anhedonia-related behavior, and spatial memory performance, respectively. RESULTS: SDS-exposed voles displayed lower sociability and body weight, decreased preference for a sucrose solution, and impairment of spatial memory retrieval. Importantly, no differences in general locomotor activity were observed as a function of SDS exposure. LIMITATIONS: This study does not include female voles in the experimental design. CONCLUSIONS: We found that repeated SDS exposure, in male prairie voles, results in a depression-relevant phenotype resembling an anhedonia-like outcome (per reductions in sucrose preference) along with social withdrawal and spatial memory impairment - highlighting that the prairie vole is a valuable model with potential to study the neurobiology of social stress-induced depression-related outcomes.

Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action.

OBJECTIVE: "Ecological validity" (EV) is classically defined as test's ability to predict real-world functioning, either alone or together with test's similarity to real-world tasks. In neuropsychological literature on assessment of executive functions (EF), EV is conceptualized inconsistently, leading to misconceptions about the utility of tests. The goal of this systematic review was to examine how EV is conceptualized in studies of EF tests described as ecologically valid. METHOD: MEDLINE and PsychINFO Databases were searched. PRISMA guidelines were observed. After applying inclusion and exclusion criteria, this search yielded 90 articles. Deductive content analysis was employed to determine how the term EV was used. RESULTS: About 1/3 of the studies conceptualized EV as the test's ability to predict functional outcomes, 1/3 as both the ability to predict functional outcome and similarity to real-world tasks, and 1/3 were either unclear about the meaning of the term or relied on notions unrelated to classical definitions (e.g., similarity to real-world tasks alone, association with other tests, or the ability to discriminate between populations). CONCLUSIONS: Conceptualizations of the term EV in literature on EF assessment vary grossly, subsuming the notions of criterion, construct, and face validity, as well as sensitivity/specificity. Such inconsistency makes it difficult to interpret clinical utility of tests that are described as ecologically valid. We call on the field to require that, at minimum, the term EV be clearly defined in all publications, or replaced with more concrete terminology (e.g., criterion validity).

The bruxism screener (BruxScreen): Development, pilot testing and face validity.

BACKGROUND: To assess awake and sleep bruxism, the Standardised Tool for the Assessment of Bruxism (STAB) is currently being developed. The STAB will be a comprehensive tool for the detailed assessment of bruxism behaviour itself as well as of its possible consequences, causes, and comorbid conditions. OBJECTIVE: Since the STAB cannot fully meet the 'A4 principle' for a bruxism assessment tool, i.e., being Accurate (reliable and valid), Applicable (feasible), Affordable (cost-effective), and Accessible (suitable for everyday clinical use), the Bruxism Screener (BruxScreen) has been developed to be used in large-scale epidemiological research projects and, especially, in general, dental practices. METHODS: The BruxScreen consists of two parts: a questionnaire (BruxScreen-Q) to be completed by patients, and a clinical assessment form (BruxScreen-C) to be completed by dentists. RESULTS: This paper describes the development of the BruxScreen and provides the outcomes of the pilot testing phase and the face validity assessment (i.e. that the first impressions of the tool indicate that it adequately reflects the construct to be measured). CONCLUSION: The resulting BruxScreen is considered ready for more profound psychometric testing in the general dental setting.

Clinical utility and validity testing of a co-designed outcome measure for hand burn injuries.

INTRODUCTION: A new outcome measure for hand burn injuries was co-designed within a Participatory Action Research framework with expert clinicians and individuals with hand burn injuries. The outcome measure reviews activities which are commonly interrupted post hand burn injuries and includes 18 activities. OBJECTIVE: The aim of this study was to establish the clinical utility, face, and content validity of the newly developed outcome measure. METHODS: Three constructs of interest were examined using study specific questionnaires from the perspectives of clinicians and individuals with hand burn injuries. Clinicians working in burns centres around Australia and New Zealand and individuals attending a burn centre within one tertiary hospital trialled the outcome measure. Upon testing the outcome measure each participant completed the questionnaire. RESULTS: Twenty individuals with hand burn injuries and eight clinicians trialled the outcome measure. There was 85% agreement from individuals and 100% agreement from clinicians for face validity. Content validity was tested across the domains of relevance and clarity. Individuals rated all activities and clinicians rated 16 activities as relevant. Clarity of activities was high for both participant groups (>75% agreement). Clinical utility (measured in the domains of appropriateness, accessibility, practicability, and acceptability) was high, 95% of individuals reported agreement for practicability and 100% agreement for acceptability. Clinicians reported agreement of > 87.5% for appropriateness, accessibility, practicability, and acceptability. CONCLUSION: The results demonstrated agreement for clinical utility, face, and content validity of the co-design outcome measure for hand burn injuries. Further validity and reliability testing is planned, including Rasch analysis.

Test-Retest Reliability of the Generalized Pain Questionnaire in Patients with Rheumatoid Arthritis and Preliminary Reference Values for Non-Clinical and Several Clinical Samples.

Introduction: Generalized pain hypersensitivity is a characteristic feature in many different types of chronic pain. Recently, a 7-item self-reported Generalized Pain Questionnaire (GPQ) was developed to evaluate the presence and severity of generalized pain hypersensitivity in chronic pain patients. Here, we evaluate the test-retest reliability of the GPQ and report on preliminary reference values for various patient groups and healthy subjects. Methods: Eighty-five patients diagnosed with Rheumatoid Arthritis (RA) completed the GPQ twice over a 2-week interval. Relative and absolute indicators of reliability were determined using data of 69 patients (81.2% retest response rate). Using readily available datasets, preliminary reference data were established in two nonclinical populations (NCP1; N = 30 and NCP2; N = 111), and for patients diagnosed with RA (N = 114), gout (N = 97), fibromyalgia (N=98), or neuropathy (N = 25), or participants in a pain rehabilitation program (N = 33). Results: Total GPQ scores had an ICC of 0.78 (95% CI: 0.67 to 0.86). While no systematic or proportional differences were found for the GPQ total score; two (near-)significant systematic differences were observed for the individual questions. The standard error of measurement and minimal detectable change were 2.22 and 6.2, respectively. Mean ± SD scores were found to be 0.8 ± 1.2 (NCP1), 4.0 ± 4.6 (NCP2), 6.4 ± 5.5 (Gout), 6.5 ± 5.1 (RA), 8.1 ± 4.5 (Neuropathy), 13.6 ± 4.0 (Rehabilitation) and 16.0 ± 5.0 (Fibromyalgia). Discussion: This study shows that the GPQ has acceptable reliability to be used as a tool to evaluate the presence and intensity of generalized pain hypersensitivity. The absolute measures of reliability and the preliminary reference values reported here aid in the interpretation of future studies with the GPQ.

Psychometric Properties of the Preschool Age Psychiatric Assessment (PAPA) in Farsi: Based on DSM-5.

Objectives: The first onset of many psychiatric disorders usually occurs in childhood or adolescence. The structured interview of Preschool Age Psychiatric Assessment (PAPA) was developed in response to the need for a standardized and reliable method to assess psychiatric disorders in preschool-age children. This study aimed to translate DSM-5-based PAPA into Farsi and evaluate its face and content validity and reliability. Materials & methods: The procedure was a forward translation of PAPA to Farsi, evaluation for face and content validity, finalization of items within the expert panel, backward translation to English, matching the original PAPA with randomly selected items from the backward translation version, and revision as needed, and finally evaluation for the validity of the changes for localization and cultural considerations. The interviews based on the final Farsi version were performed on thirty parents of children from two to five years old (chosen from Tabriz health centers) to determine the reliability and were repeated at an interval of two weeks. Results:  The mean of CVI=0.91 and Modified Kappa=0.90 were obtained, and reliability with Cronbach's alpha was 0.89. Conclusion:  The Farsi version of the DSM-5-based PAPA diagnostic interview has good face and content validity and reliability.

Adaptation and content validation of a patient-reported measure of treatment burden for use in stroke survivors: the patient experience with treatment and self-management in stroke (PETS-stroke) measure.

PURPOSE: Stroke survivors often live with significant treatment burden yet our ability to examine this is limited by a lack of validated measurement instruments. We aimed to adapt the 60-item, 12-domain Patient Experience with Treatment and Self-Management (PETS) (version 2.0, English) patient-reported measure to create a stroke-specific measure (PETS-stroke) and to conduct content validity testing with stroke survivors. MATERIALS AND METHODS: Step 1 - Adaptation of PETS to create PETS-stroke: a conceptual model of treatment burden in stroke was utilised to amend, remove or add items. Step 2 - Content validation: Fifteen stroke survivors in Scotland were recruited through stroke groups and primary care. Three rounds of five cognitive interviews were audio recorded and transcribed. Framework analysis was used to explore importance/relevance/clarity of PETS-stroke content. COSMIN reporting guidelines were followed. RESULTS: The adapted PETS-stroke had 34 items, spanning 13 domains; 10 items unchanged from PETS, 6 new and 18 amended. Interviews (n = 15) resulted in further changes to 19 items, including: instructions; wording; item location; answer options; and recall period. CONCLUSIONS: PETS-stroke has content that is relevant, meaningful and comprehensible to stroke survivors. Content validity and reliability testing are now required. The validated tool will aid testing of tailored interventions to lessen treatment burden.IMPLICATIONS FOR REHABILITATIONTreatment burden is reported by stroke survivors but no stroke-specific measure of treatment burden exists.We adapted an existing measure of treatment burden for use in multimorbid patients (PETS) to create a stroke specific version (PETS-stroke).The items in PETS-stroke are relevant and meaningful to people with stroke.Further testing will examine construct validity, reliability, and useability.This measure will be useful in future RCTs to measure treatment burden and to identify stroke patients who are at high risk of treatment burden.

Development of the Canadian Eating Practices Screener to assess eating practices based on 2019 Canada's Food Guide recommendations.

In 2019, Health Canada released a new iteration of Canada's Food Guide (2019-CFG), which, for the first time, highlighted recommendations regarding eating practices, i.e., guidance on where, when, why, and how to eat. The objective of this study was to develop a brief self-administered screener to assess eating practices recommended in the 2019-CFG among adults aged 18-65 years. Development of the screener items was informed by a review of existing tools and mapping of items onto 2019-CFG recommendations. Face and content validity were assessed with experts in public health nutrition and/or dietary assessment (n = 16) and individuals from Government of Canada (n = 14). Cognitive interviews were conducted with English-speaking (n = 16) and French-speaking (n = 16) adults living in Canada to assess face validity and understanding of the screener items. While some modifications were identified to improve relevance or clarity, overall, the screener items were found to be relevant, well-constructed, and clearly worded. This comprehensive process resulted in the Canadian Eating Practices Screener/Questionnaire court canadien sur les pratiques alimentaires, which includes 21 items that assess eating practices recommended in the 2019-CFG. This screener can facilitate monitoring and surveillance efforts of the 2019-CFG eating practices as well as research exploring how these practices are associated with various health outcomes.

Development of the Malay Language of understanding, attitude, practice and health literacy questionnaire on COVID-19 (MUAPHQ C-19): content validity & face validity analysis.

OBJECTIVE: This study aimed to assess the content and face validity index of the development of the understanding, attitude, practice and health literacy questionnaire on COVID-19 (MUAPHQ C-19) in the Malay language. METHODS: The development of the MUAPHQ C-19 was conducted in two stages. Stage I resulted in the generation of the instrument's items (development), and stage II resulted in the performance of the instrument's items (judgement and quantification). Six-panel experts related to the study field and ten general public participated to evaluate the validity of the MUAPHQ C-19. The content validity index (CVI), content validity ratio (CVR) and face validity index (FVI) were analysed using Microsoft Excel. RESULTS: There were 54 items and four domains, namely the understanding, attitude, practice and health literacy towards COVID-19, identified in the MUAPHQ C-19 (Version 1.0). The scale-level CVI (S-CVI/Ave) for every domain was above 0.9, which is considered acceptable. The CVR for all items was above 0.7, except for one item in the health literacy domain. Ten items were revised to improve the item's clarity, and two items were deleted due to the low CVR value and redundancy, respectively. The I-FVI exceeded the cut-off value of 0.83 except for five items from the attitude domain and four from the practice domains. Thus, seven of these items were revised to increase the clarity of items, while another two were deleted due to low I-FVI scores. Otherwise, the S-FVI/Ave for every domain exceeded the cut-off point of 0.9, which is considered acceptable. Thus, 50-item MUAPHQ C-19 (Version 3.0) was generated following the content and face validity analysis. CONCLUSIONS: The questionnaire development, content validity, and face validity process are lengthy and iterative. The assessment of the instruments' items by the content experts and the respondents is essential to guarantee the instrument's validity. Our content and face validity study has finalised the MUAPHQ C-19 version that is ready for the next phase of questionnaire validation, using Exploratory and Confirmatory Factor Analysis.

Updated Decision Aid Enabling Women to Choose between with or without Epidural Analgesia during Childbirth, and Confirmation of Validity.

BACKGROUND: The use of a decision aid for choosing whether to have or not have anesthesia during childbirth has been shown to increase both knowledge about birth and the proportion of women who made their own decisions compared with women who did not use a decision aid. Herein, we updated the first version of our decision aid into a second version and evaluated this updated decision aid. We evaluated the face validity and content appropriateness of the updated decision aid developed to enhance the ability of women to choose between childbirth with or without epidural analgesia. METHODS: This was a descriptive study based on a literature review of updated information for addition to the first version. PubMed and Cochrane Library were searched from 2003 to May 2021. Thereafter, obstetricians, anesthesiologists, and midwives were asked to respond to a questionnaire regarding the face validity and content appropriateness of the updated decision aid regarding whether it meets the IPDASi (Version 4.0) quality standards. RESULTS: One obstetrician, one anesthesiologist, and three midwives who had performed epidural anesthesia for at least three years responded to the questionnaire. The responses to the evaluation items of face validity (i.e., style and clarity) were positive. There were 38 specific comments regarding content appropriateness classified into seven categories: "addition or revision of text", "unification of expressions", "need for explanation/information", "lack of evidence", "potential to mislead", "questionable", and "structure". CONCLUSION: The face validity and content appropriateness of the updated decision aid was confirmed. The next step is evaluation of the updated decision aid by pregnant women who give birth.

Face Validity, Content Validity, and Psychometric Testing of the Hospital Survey on Patient Safety Culture Among Undergraduate Nursing Students.

Background and Purpose: Nursing students have an essential role in patient safety. The purpose of this study was to evaluate the face validity, content validity, and psychometric properties of the Hospital Survey on Patient Safety Culture for Nursing Students (HSOPS-NS). Methods: The cross-sectional study was carried out between January and October 2021. The participants were undergraduate nursing students (N = 482) from 16 Czech nursing faculties. Results: Exploratory factor analysis revealed an eight-factor structure, which was verified by confirmatory factor analysis using the optimization process that results in adequate goodness-of-fit indices (root mean squared error approximation = .037; standardized root mean squared residuals = .056; comparative fit index = .935; Tucker-Lewis index = .926; incremental fit index = .936). The internal consistency of a new model was excellent (α = .914). Conclusion: The results indicate that the HSOPS-NS shows evidence of reliability and validity and is a valuable measure of safety culture as perceived by nursing students.

Lay Definitions of Intelligence, Knowledge, and Memory: Inter- and Independence of Constructs.

The present study examined how lay participants define the following concepts used widely in psychology: being intelligent, knowing, and remembering. In the scientific community, knowledge overlaps with the contents of semantic memory, crystallized intelligence reflects the accumulation of knowledge, knowledge and event memory interact, and fluid intelligence and working memory correlate. Naturally, the lay public has implicit theories of these constructs. These theories mainly distinguish between intelligent and unintelligent behaviors and tend to include characteristics outside psychometric studies of intelligence, such as emotional intelligence. Here, we asked lay participants from the online platform Prolific to explain "what does being intelligent mean to you?" as well as "knowing" and "remembering" to understand their degree of alignment with theoretical conceptualizations in the research community. Qualitative coding of participant definitions showed that intelligence and knowledge are closely related, but asymmetrically-when defining what it means to be intelligent, participants reference knowledge, but intelligence is not considered in explaining knowing. Although participants note that intelligence is multi-faceted and related to problem-solving, there is an emphasis (in terms of frequency of mentions) on the crystallized side of intelligence (i.e., knowledge). A deeper understanding of lay participants' mental models of these constructs (i.e., their metacognitions) is essential for bridging gaps between experts and the general public.

Content, face, and construct validity of the Irritable Bowel Syndrome Quality of Life (IBS-QOL) as a measure of bowel-related quality of life in spinal cord injury.

INTRODUCTION: Neurogenic bowel dysfunction is commonly encountered after a spinal cord injury (SCI), leading to a tremendous impact on quality of life (QOL). The neurogenic bowel dysfunction score (NBDS) is commonly used to measure the severity of bowel dysfunction and predict QOL. However, there is no comprehensive instrument to assess bowel-specific QOL for SCI patients. Instead, the Irritable Bowel Syndrome-Quality of Life (IBS-QOL) questionnaire evaluates the impact of bowel dysfunction on several aspects of QOL, although this questionnaire has not been validated for the SCI population. Motivated by the compelling need of instruments to accurately evaluate the QOL in patients who develope NBD after SCI, we aimed to assess the construct, content, and face validity of IBS-QOL in this population. METHODS: Adult SCI patients with at least 3 months after their injury were recruited from the outpatient clinic of a national rehabilitation hospital. Patients completed the NBDS and IBS-QOL via telephone interview or paper survey in the clinic. Content and face validity were assessed via interviews with professionals with expertise in providing chronic care for SCI, as well as a subgroup of patients. Construct validity was assessed using the hypotheses testing method. Internal consistency was assessed using Cronbach's ⍺. Factor analysis was performed to assess the dimensionality of the IBS-QOL in the SCI population. RESULTS: A total of 106 patients with a median age of 45.5 years (interquartile range: 21-79) participated in the study. The majority of the sample were men (n = 82, 77%) and had endured thoracolumbar injuries (n = 74, 71.2%). Twelve patients (seven English- and five Spanish speakers) and six professionals took part in content/face validation interviews. The median IBS-QOL total score was 15.91/100 (interquartile range: 4.55-33.14). IBS-QOL differentiated the subgroups of patients with severe bowel symptoms in terms of uneasiness, sweating, or headaches during bowel emptying (p = 0.0003), time spent on bowel emptying (p = 0.0065), flatus incontinence (p = 0.0076), and overall satisfaction with bowel function (p < 0.001), demonstrating its adequate construct validity. Interviews with the patients and professionals supported the comprehensiveness, comprehensibility, and relevance of IBS-QOL for assessment of bowel-related QOL in the SCI population. Item-level analysis of professional responses showed that 97% of questions were relevant to the construct and population of interest. Internal consistency analysis yielded a Cronbach's ⍺ of 0.9684. Exploratory factor analysis yielded six underlying factors which cumulatively accounted for 72.21% of the total variance, reflecting the dimensionality of bowel-related QOL in SCI population. DISCUSSION: IBS-QOL questionnaire is a comprehensive measure of bowel-related QOL which encompasses the concerns of SCI patients. Our findings support the content, face and construct validity of IBS-QOL as a measure of bowel-related QOL in SCI. Further studies are warranted to assess the reliability and responsiveness of IBS-QOL, and to evaluate its performance across different patient populations.

Developing and testing inter-rater reliability of a data collection tool for patient health records on end-of-life care of neurological patients in an acute hospital ward.

AIM: Develop and test a data collection tool-Neurological End-Of-Life Care Assessment Tool (NEOLCAT)-for extracting data from patient health records (PHRs) on end-of-life care of neurological patients in an acute hospital ward. DESIGN: Instrument development and inter-rater reliability (IRR) assessment. METHOD: NEOLCAT was constructed from patient care items obtained from clinical guidelines and literature on end-of-life care. Expert clinicians reviewed the items. Using percentage agreement and Fleiss' kappa we calculated IRR on 32 nominal items, out of 76 items. RESULTS: IRR of NEOLCAT showed 89% (range 83%-95%) overall categorical percentage agreement. The Fleiss' kappa categorical coefficient was 0.84 (range 0.71-0.91). There was fair or moderate agreement on six items, and moderate or almost perfect agreement on 26 items. CONCLUSION: The NEOLCAT shows promising psychometric properties for studying clinical components of care of neurological patients at the end-of-life on an acute hospital ward but could be further developed in future studies.

Determination of Relative Weightings for Sacroiliac Joint Pathologies in the OMERACT Juvenile Arthritis Magnetic Resonance Imaging Sacroiliac Joint Score.

This study aims to determine the relative weights (point value) of items of the juvenile idiopathic arthritis magnetic resonance imaging-sacroiliac joint scoring system (JAMRIS-SIJ). An adaptive multicriteria decision analysis was performed using the 1000Minds web application to determine the relative weights of the items in the JAMRIS-SIJ inflammation and damage domains. Experts in imaging and rheumatology independently completed a conjoint analysis survey (CAS) to determine the point value of the measurement items of the JAMRIS-SIJ. Each CAS survey question asked the expert to compare two hypothetical patient profiles, which were otherwise similar but different at two items at a time, and to select which item showed a more severe stage of inflammation or osteochondral damage. In addition, experts ranked 14 JAMRIS-SIJ grade only or image + grade patient vignettes while blinded to the CAS-derived weights. The validity of the weighted JAMRIS-SIJ was tested by comparing the expert CAS-weighted score and the image + grade ranking method. Seventeen experts completed the CAS (11 radiologists and 6 rheumatologists). Considering the point value for inflammation domain items, osteitis (24.7%) and bone marrow edema (24.3%) had higher group-averaged percentage weights compared to inflammation in erosion cavity (16.9%), joint space enhancement (13.1%), joint space fluid (9.1%), capsulitis (7.3%), and enthesitis (4.6%). Similarly, concerning the damage domain, ankylosis (41.3%) and erosion (25.1%) showed higher group-averaged weights compared to backfill (13.9%), sclerosis (10.7%), and fat metaplasia lesion (9.1%). The Spearman correlation coefficients of the CAS-weighted vignette order and unweighted JAMRIS-SIJ grade only order vignettes for all experts were 0.79 for inflammation and 0.80 for damage. The correlations of image vignettes among imaging experts to CAS were 0.75 for inflammation and 0.90 for damage. The multicriteria decision analysis identified differences in relative weights among the JAMRIS-SIJ measurement items. The determination of the relative weights provided expert-driven score scaling and face validity for the JAMRIS-SIJ, enabling the future evaluation of its longitudinal construct validity.