Intra and Inter-Device Reliabilities of the Instrumented Timed-Up and Go Test Using Smartphones in Young Adult Population.

The Timed-Up and Go (TUG) test is widely utilized by healthcare professionals for assessing fall risk and mobility due to its practicality. Currently, test results are based solely on execution time, but integrating technological devices into the test can provide additional information to enhance result accuracy. This study aimed to assess the reliability of smartphone-based instrumented TUG (iTUG) parameters. We conducted evaluations of intra- and inter-device reliabilities, hypothesizing that iTUG parameters would be replicable across all experiments. A total of 30 individuals participated in Experiment A to assess intra-device reliability, while Experiment B involved 15 individuals to evaluate inter-device reliability. The smartphone was securely attached to participants' bodies at the lumbar spine level between the L3 and L5 vertebrae. In Experiment A, subjects performed the TUG test three times using the same device, with a 5 min interval between each trial. Experiment B required participants to perform three trials using different devices, with the same time interval between trials. Comparing stopwatch and smartphone measurements in Experiment A, no significant differences in test duration were found between the two devices. A perfect correlation and Bland-Altman analysis indicated good agreement between devices. Intra-device reliability analysis in Experiment A revealed significant reliability in nine out of eleven variables, with four variables showing excellent reliability and five showing moderate to high reliability. In Experiment B, inter-device reliability was observed among different smartphone devices, with nine out of eleven variables demonstrating significant reliability. Notable differences were found in angular velocity peak at the first and second turns between specific devices, emphasizing the importance of considering device variations in inertial measurements. Hence, smartphone inertial sensors present a valid, applicable, and feasible alternative for TUG assessment.

Evaluating knowledge and attitudes scales for the care of older adults among nursing students in Ghana.

BACKGROUND: Understanding nursing students' knowledge about and attitudes toward older adults' using context-specific survey instruments can help to identify and design effective learning and teaching materials to improve the care for persons 60 years and above. However, there are no validated instruments to examine nursing students' knowledge and attitudes toward the care for older adults in the African context. The study aimed to evaluate the items on the Knowledge about Older Patients Quiz and Kogan's Attitudes towards Old People Scale suitable for the African context. METHODS: A cross-sectional study was conducted using second-and third-year nursing students from two public Nursing Training Institutions in Ghana. Using Sahin's rule of sample size estimate of at least 150 participants for unidimensional dichotomous scales, 170 nursing students were recruited to participate after an information session in their classrooms. Data were collected from December 2019-March 2020 using the Knowledge about Older Patients Quiz and Kogan's Attitudes Towards Old People Scale. Item response theory was employed to evaluate the Knowledge about Older Patients Quiz difficulty level and discrimination indices. Corrected item-to-total correlation analysis was conducted for Kogan's Attitudes towards Old People Scale. The internal consistency for both scales was examined. RESULTS: Of the 170 participants, 169 returned completed surveys. The mean age of participants was 21 years (SD = 3.7), and (54%) were female. Of the 30-items of the Knowledge about Older Patients Quiz, seven items were very difficult for most students to choose the correct response, and one was easy, as most of the students chose the correct response. Although 22 items demonstrated appropriate difficulty level, discrimination indices were used to select the final 15- items that discriminated moderately between upper and lower 25% performing students. The Kuder-Richardson-20 reliability was. 0.30, which was low. Considering Kogan's Attitudes towards Old People scale, 10-items were removed following negative and low corrected item-to-total correlation and a high Alpha coefficient if items were deleted. The final 22-items had a Cronbach alpha coefficient of 0.65, which was moderately satisfactory. CONCLUSION: Evaluation of the scales demonstrated essential content validity and moderate internal consistency for the context of our study. Further research should focus on ongoing context-specific refinement of the survey instruments to measure nursing students' knowledge about and attitudes toward caring for older adults in the African context.

Missingness patterns in a comprehensive instrument identifying psychosocial and substance use risk in antenatal care.

BACKGROUND: Psychosocial vulnerabilities (e.g. inadequate social support, financial insecurity, stress) and substance use elevate risks for adverse perinatal outcomes and maternal mental health morbidities. However, various barriers, including paucity of validated, simple and usable comprehensive instruments, impede execution of the recommendations to screen for such vulnerabilities in the first antenatal care visit. The current study presents findings from a newly implemented self-report tool created to overcome screening barriers in outpatient antenatal clinics. METHODS: This was a retrospective chart-review of 904 women who completed the Profile for Maternal & Obstetric Treatment Effectiveness (PROMOTE) during their first antenatal visit between June and December 2019. The PROMOTE includes the 4-item NIDA Quick Screen and 15 additional items that each assess a different psychosocial vulnerability. Statistical analysis included evaluation of missing data, and exploration of missing data patterns using univariate correlations and hierarchical clustering. RESULTS: Three quarters of women (70.0%) had no missing items. In the entire sample, all but four PROMOTE items (opioid use, planned pregnancy, educational level, and financial state) had < 5% missing values, suggesting good acceptability and feasibility. Several respondent-related characteristics such as lower education, less family support, and greater stress were associated with greater likelihood of missing items. Instrument-related characteristics associated with missing values were completing the PROMOTE in Spanish or question positioning at the end of the instrument. CONCLUSIONS AND IMPLICATIONS: Conducting a comprehensive screening of theoretically and clinically meaningful vulnerabilities in an outpatient setting is feasible. Study findings will inform modifications of the PROMOTE and subsequent digitisation.

Reliability and validity of the Greek translation of the patient assessment of chronic illness care + (PACIC-PLUS GR) survey.

BACKGROUND: This study aimed to investigate the Patient Assessment of Chronic Illness Care+ (PACIC+) which is a tool to assess care for Chronic Conditions combining PACIC items with an overall 5As score derived from the '5As' model (ask, advise, agree, assist, and arrange), and is congruent with the Chronic Care Model. In addition, the study at hand aimed to translate the PACIC+ tool into Greek and test its psychometric properties to the Greek patients. METHODS: Questionnaires were collected from 268 chronic patients. Internal consistency and reliability were determined by the calculation of Cronbach's alpha coefficient. A confirmatory factor analysis (CFA) was conducted in order to test the construct validity of the questionnaire. Validity was further examined by investigating the correlation of PACIC+ with SF-36 and its association with sex and age. RESULTS: Internal consistency reliability was accepted with a Cronbach's alpha above 0.70 for all PACIC+ dimensions. CFA showed that the 10-dimensional model fitted the data well (RMSEA = 0.059, CFI = 0.91 and GFI = 0.83). Most of the correlations coefficients between PACIC+ and SF-36 dimensions were significant. A significant and negative correlation was found between PACIC+ summary score, Patients' activation and Goal Setting/ Tailoring with age. CONCLUSIONS: The Greek translation of the PACIC+ questionnaire has good psychometric properties and has proven to be a credible and valid tool to be used by Greek researchers in order to measure patients' perceived care during treatment. It demonstrated high reliability and internal consistency, extending the applicability of this instrument to Greek speaking chronic patients.

Evaluating and establishing national norms for mental wellbeing using the short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS): findings from the Health Survey for England.

PURPOSE: The Warwick-Edinburgh Mental Well-being Scale (WEMWBS), 14 positively worded statements, is a validated instrument to measure mental wellbeing on a population level. Less is known about the population distribution of the shorter seven-item version (SWEMWBS) or its performance as an instrument to measure wellbeing. METHODS: Using the Health Survey for England 2010-2013 (n = 27,169 adults aged 16+, nationally representative of the population), age- and sex-specific norms were estimated using means and percentiles. Criterion validity was examined using: (1) Spearman correlations (ρ) for SWEMWBS with General Health Questionnaire (GHQ-12), happiness index, EQ-VAS (2) a multinomial logit model with SWEMWBS (low, medium and high wellbeing) as the outcome and demographic, social and health behaviours as explanatory variables. Relative validity was examined by comparing SWEMWBS with WEMWBS using: (1) Spearman correlations (continuous data), and (2) the weighted kappa statistic (categorical), within population subgroups. RESULTS: Mean (median) SWEMWBS was 23.7 (23.2) for men and 23.2 (23.2) for women (p = 0.100). Spearman correlations were moderately sized for the happiness index (ρ = 0.53, P < 0.001), GHQ-12 (ρ = -0.52, p < 0.001) and EQ-VAS (ρ = 0.40, p < 0.001). Participants consuming <1 portion of fruit and vegetables a day versus ≥5 (odds ratio = 1.43 95% Confidence Interval = (1.22-1.66)) and current smokers versus non-smokers (1.28 (1.15-1.41)) were more likely to have low vs medium wellbeing. Participants who binge drank versus non-drinkers were less likely to have high versus medium wellbeing (0.81 (0.71-0.92)). Spearman correlations between SWEMWBS and WEMWBS were above 0.95; weighted kappa statistics showed almost perfect agreement (0.79-0.85). CONCLUSION: SWEMWBS distinguishes mental wellbeing between subgroups, similarly to WEMWBS, but is less sensitive to gender differences.

Psychometric evaluation of a questionnaire and primary healthcare nurses' attitudes towards research and use of research findings.

AIM: This article investigates attitudes towards and awareness of research and use of research findings among primary healthcare nurses, determinants of attitudes and evaluation of psychometric properties of an instrument measuring nurses' attitudes. BACKGROUND: The production of new knowledge is ongoing and the amount of research of relevance for health care has increased, but there remains a gap between what is known and what is done in practice. To enhance evidence-based practice and patient safety, the use of research findings needs to be encouraged and promoted. METHOD: An explanatory study using a cross-sectional survey was conducted in 2005-2006. The survey included items about background data and the instrument attitudes towards and awareness of research and development in nursing. 1054 nurses participated in the study. Factor analyses and Cronbach's alpha were used to evaluate internal structure and internal consistency of the instrument. RESULT: The nurses generally held positive attitudes towards research. Although most of the nurses reported using research in practice, 37% claimed that they never or rarely used research findings. Half of the respondents perceived they had the ability to analyse scientific reports/articles. This ability and research use were significant determinants of attitudes. Factor analysis of the scale resulted in a three-factor solution, which differs from the seven-factor structure previously identified by the originators of the instrument. CONCLUSION: Our results support the view that implementation of research is a complex process involving several factors. The different factor structure identified suggests that further work is needed on this instrument.

Performance evaluation of the Sysmex XN-1000V in side-by-side comparison with the Siemens ADVIA 120 and manual methods for healthy CD Sprague-Dawley rats and CD-1 mice.

BACKGROUND: The Sysmex XN-1000V automated hematology analyzer with multispecies software was released in June 2017 for use in research laboratories. Laser light, impedance, fluorescent staining, and fluorescent flow cytometry are used to analyze whole blood for CBC, reticulocyte counts, and WBC counts, including a 5-part differential leukocyte analysis. OBJECTIVES: A side-by-side comparison of the Sysmex XN-1000V with the Siemens ADVIA 120 in analyzing blood from healthy mice and rats will provide insight into the performance of the new analyzer and its capabilities for use in drug development studies. Method correlation analyses on normal mouse and rat hematology data collected with both analyzers and manual reference methods will help determine the reliability of the data produced using the Sysmex XN-1000V analyzer. METHODS: Whole blood samples collected in K2 EDTA from healthy CD-1 mice and CD Sprague-Dawley rats were analyzed in parallel with the XN-1000V and ADVIA 120 analyzers. Male and female mice, approximately 6-9 weeks old, and male and female rats, approximately 7-9 weeks old, were included in this study. Manual reference methods for WBC differential leukocyte analysis and packed cell volume (PCV) measurements were also performed. EP Evaluator version 11.2 (Data Innovations LLC, South Burlington, VT, USA) was used for method comparison statistical analysis. RESULTS: Most hematologic parameters for naïve mice and rats achieved correlation in the fair to excellent range, with the majority showing very good to excellent correlation with low biases (<11.0%) for cohorts analyzed separately and when cohort data were combined. CONCLUSIONS: The Sysmex XN-1000V Hematology Analyzer provided comparable results to those obtained from the Siemens ADVIA 120. We found the Sysmex XN-1000V Hematology Analyzer to be acceptable for use in drug development studies for rats and mice.

Examining concurrent validity and item selection of the Session Wants and Needs Outcome Measure (SWAN-OM) in a children and young people web-based therapy service.

Background: Single-session mental health interventions are frequently attended by children and young people (CYP) in both web-based and face-to-face therapy settings. The Session "Wants" and "Needs" Outcome Measure (SWAN-OM) is an instrument developed in a web-based therapy service to overcome the challenges of collecting outcomes and experiences of single-session therapies (SSTs). It provides pre-defined goals for the session, selected by the young person prior to the intervention, on which progress toward achievement is scored at the end of the session. Objective: The objective of this study was to evaluate the instrument's psychometric properties, including concurrent validity against three other frequently used outcome and experience measures, at a web-based and text-based mental health service. Methods: The SWAN-OM was administered for a period of 6 months to 1,401 CYP (aged 10-32 years; 79.3% white; 77.59% female) accessing SST on a web-based service. Item correlations with comparator measures and hierarchical logistic regressions to predict item selection were calculated for concurrent validity and psychometric exploration. Results: The most frequently selected items were "Feel better" (N = 431; 11.61%) and "Find ways I can help myself" (N = 411; 11.07%); unpopular items were "Feel safe in my relationships" (N = 53; 1.43%) and "Learn the steps to achieve something I want" (N = 58; 1.56%). The SWAN-OM was significantly correlated with the Experience of Service Questionnaire, particularly the item "Feel better" [rs(109) = 0.48, p < 0.001], the Youth Counseling Impact Scale, particularly the item "Learn the steps to achieve something I want" [rs(22) = 0.76, p < 0.001], and the Positive and Negative Affect Schedule, particularly the items "Learn how to feel better" [rs(22) = 0.72, p < 0.001] and "Explore how I feel" [rs(70) = -0.44, p < 0.001]. Conclusion: The SWAN-OM demonstrates good concurrent validity with common measures of outcome and experience. Analysis suggests that lesser-endorsed items may be removed in future iterations of the measure to improve functionality. Future research is required to explore SWAN-OM's potential to measure meaningful change in a range of therapeutic settings.

Online Mental Health Survey for Addressing Psychosocial Condition During the COVID-19 Pandemic in Indonesia: Instrument Evaluation.

BACKGROUND: Regular monitoring of the pandemic's psychosocial impact could be conducted among the community but is limited through online media. This study aims to evaluate the self-rating questionnaire commonly used for online monitoring of the psychosocial implications of the coronavirus disease 2019 (COVID-19) pandemic. METHODS: The data were taken from the online assessment results of two groups, with a total of 765 participants. The instruments studied were Self-Rating Questionnaire (SRQ-20), post-traumatic stress disorder (PTSD), and Center for Epidemiological Studies Depression Scale-10 (CESD-10), used in the online assessment. Data analysis used Rasch modeling and Winsteps applications. Validity and reliability were tested, and data were fit with the model, rating scale, and item fit analysis. RESULTS: All the scales for outfit mean square (MnSq) were very close to the ideal value of 1.0, and the Chi-square test was significant. Item reliability was greater than 0.67, item separation was greater than 3, and Cronbach's alpha was greater than 0.60; all the instruments were considered very good. The raw variance explained by measures for the SRQ-20, PTSD, and CESD-10 was 30.7%, 41.6%, and 47.6%, respectively. The unexplained eigenvalue variances in the first contrast were 2.3, 1.6, and 2.0 for the SRQ-20, PTSD, and CESD-10, respectively. All items had positive point-measure correlations. CONCLUSION: The internal consistency of all the instruments was reliable. Data were fit to the model as the items were productive for measurement and had a reasonable prediction. All the scales are functionally one-dimensional.

Interrater reliability of the BelRAI Social Supplement in Flanders, Belgium: Simultaneous rating of community-dwelling adults with care needs during COVID-19.

Background: The BelRAI Screener is a short-form assessment consolidating internationally validated interRAI items focusing on physical and psychological aspects of functioning and problems with activities of daily living. It was fully implemented in the Flemish home care setting as of June 2021. In a biopsychosocial model for developing a personalized and effective care plan social and contextual aspects are considered equally important to biomedical ones. Thus, a social supplement to the BelRAI Screener was collaboratively developed with stakeholders and tested to gather additional information on the social context of community-dwelling adults with care needs. Objective and methods: To examine the interrater reliability of the BelRAI Social Supplement in Flanders, Belgium, an observational study was conducted using a convenience sample. The method of simultaneous rating was used due to strict COVID-19 guidelines at the time and to minimize assessment burden. Fifty two community-dwelling adults requesting home care support were simultaneously assessed by two independent assessors during home visits. Interrater reliability was tested on all 80 items of the BelRAI Social Supplement using observed agreement, kappa coefficients, and intraclass correlation coefficients. Results: The kappa mean (0.74) and median (0.79) values for nominal items, show substantial agreement, while the kappa mean and median values for ordinal items were 0.81 and 0.90, which correspond to almost perfect agreement. Following the traditional cut-off points for the interpretation of the kappa statistic, reliability was almost perfect (κ > 0.81) for 49% of all items, substantial (0.60 < κ ≤ 0.80) for 33%, moderate (0.40 < κ ≤ 0.60) for 8%, and poor (κ < 0.40) for 10%. The majority of items with poor kappa value, showed a high observed agreement, reflecting homogeneity of the sample rather than poor agreement. Conclusion: The strength of kappa agreement for the items in this version of the BelRAI Social Supplement is generally substantial to almost perfect, with high proportions of observed agreement. COVID-19 restrictions had a large impact on the planning and execution of the home visits. A final optimization of the instrument and accompanying manual according to the findings will result in an improved version ready for nation-wide implementation.

Psychometric evaluation of the Chinese version of the Person-Centred Care Assessment Tool.

OBJECTIVE: This study aims to test a Chinese cross-cultural adaptation of the English version of the Person-Centred Care Assessment Tool (P-CAT) and evaluate its psychometric properties. DESIGN: P-CAT was translated/back-translated using established procedures before the psychometric evaluation of the Chinese version was made. SETTING: Two hospitals covering urban and suburban areas of Kunming in the Yunnan province of China. PARTICIPANTS: 152 female hospital staff completed the survey. MAIN OUTCOME MEASURES: Construct validity and reliability, including internal consistency and test-retest reliability, were assessed among a sample of hospital staff. RESULTS: The factor analysis resulted in a two-component solution that consisted of two subscales. The corrected item-total correlations for all of the items ranged from 0.14 to 0.44, with six items not meeting the cut-off level for item-total correlation (>0.3). The Chinese P-CAT demonstrated strong reliability, with a Cronbach's alpha of 0.91-0.94 for the scales and a test-retest reliability coefficient of 0.88 for the overall scale scores. The intraclass correlation was 0.92 (95% CI 0.90 to 0.95). CONCLUSION: P-CAT appears to be a promising measure for evaluating staff perceptions of person-centredness in Chinese hospital environments. The results show that P-CAT can be a useful tool for improving the quality of healthcare in terms of person-centred care in the Chinese context.

Measuring Development of Adolescent and Young Adult Cancer Patients: An Integrative Review of Available Instruments.

Adolescents and young adults (AYAs) 15-39 years old face unique challenges during cancer treatment as developmental and social needs are often disrupted to achieve cure. Developmentally appropriate supportive care for AYAs across the cancer trajectory is needed. The purpose of this review is to identify and describe instruments that measure AYA development across physical, psychological, and social domains, commenting on the instruments' psychometric properties and usefulness in clinical practice and research. A computerized literature search published in English from 1950 to January of 2017 was conducted utilizing the following databases: Mental Measurements Yearbook (MMY), Health and Psychosocial Instruments, PubMed, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, and Google Scholar. The following instruments were identified and described: the Child Health and Illness Profile-Adolescent Edition (CHIP-AE); the Course of Life Questionnaire; the Developmental Task Questionnaire (DTQ); the Impact of Cancer scale for childhood survivors and AYAs (IOC-CS and IOC-AYA); the McCleery Scale of Adolescent Development (MSAD); and the Minneapolis-Manchester Quality of Life Adolescent and Young Adult Form (MMQL-AF and MMQL-YA). Among currently available instruments, the IOC-AYA and MMQL-AF were relevant to AYAs undergoing or completing cancer therapy. However, validation for the IOC-AYA occurred in cancer survivors off treatment so further psychometric evaluation is needed in AYAs currently undergoing cancer treatment. Furthermore, the MMQL-AF has been validated for use during active cancer treatment, but is limited to adolescents 13-20 years. Further research may be needed to create or refine instruments measuring the developmental impact in AYAs, particularly emerging adults undergoing active cancer treatment.

Establishing the Validity and Reliability Evidence of Preceptor Assessment of Student Tool.

Objective. To evaluate the validity and reliability evidence of the preceptor assessment of student tool (PAST) which was designed to assess doctor of pharmacy (PharmD) student rotation performance. Methods. Evaluation data were loaded into WINSTEPS software to conduct a Rasch rating scale analysis. Validity evidence was examined from construct and content validity perspectives, and reliability was assessed via student and item separation index and reliability coefficient. Data from 435 observations were included in the analysis. Results. All 19 items measured the same construct of interest and the five-point rating scale functioned appropriately and differentiated students' ability. However, the item/person map indicated an absence of items at the end of the measurement continuum. Conclusion. Although adding items at the end of the measurement continuum may be beneficial, PAST showed good validity and reliability evidence when used to evaluate PharmD student rotations and is suitable to assess mastery learning.

Instruments for the evaluation of motor abilities for children with severe multiple disabilities: A systematic review of the literature.

Based on a systematic review, psychometric characteristics of currently available instruments on motor abilities of children with disabilities were evaluated, with the aim to identify candidates for use in children with severe multiple (intellectual and motor) disabilities. In addition, motor abilities are essential for independent functioning, but are severely compromised in these children. The methodological quality of all studies was evaluated with the Consensus Based Standards for the Selection of Health Status Measurement Instruments (COSMIN) Checklist; overall levels of evidence per instrument were based on the Cochrane Back Review Group strategy. As a result, 18 studies with a total of eight instruments, developed for children with cerebral palsy (CLA, GMFM-88 and LE85), spinal muscular atrophy (MHFMS), neuromuscular diseases (MFM), disabilities 0-6 years (VAB, WeeFIM), and one developed specifically for children with severe multiple disabilities (TDMMT) were found. Strong levels of evidence were found for construct validity of LE85 and MFM and for responsiveness of WeeFIM, but reliability studies of these instruments had a limited methodological quality. Up to now studies of the TDMMT resulted in limited and unknown evidence for structural validity due to the poor methodological quality of reliability studies. In a next step, the clinical suitability of the instruments for children with severe multiple disabilities will be evaluate.