When better is the enemy of good: two cautionary tales of conceptual validity versus parsimony in clinical psychometric research.

This paper presents an empirical challenge to the assumption that an item-response theory analysis always yields a better measure of a clinical construct. We summarize results from two measurement development studies that showed that such an analysis lost important content reflecting the conceptual model ("conceptual validity"). The cost of parsimony may thus be too high. Conceptual models that form the foundation of QOL measurement reflect the patient's experience. This experience may include concepts and items that are psychometrically "redundant" but capture distinct features of the concept. Good measurement is likely a balance between relying on IRT's quantitative metrics and recognizing the importance of conceptual validity and clinical utility.

Factor structure and reliability of the symptom measurement of post-stroke depression in the rehabilitation stage.

BACKGROUND: The incidence of Post Stroke Depression (PSD) in the Rehabilitation Stage is high, which can bring serious physical and psychological disorders to patients. However, there is still a lack of targeted tools for screening PSD in the rehabilitation stage. Therefore, the aim of this study was to evaluate the factor structure and reliability of a measurement instrument to screen for PSD in the rehabilitation stage. METHODS: A cross-sectional study was conducted on 780 hospitalized stroke patients who were within the rehabilitation stage from May to August 2020. Exploratory factor analysis (EFA) as well as first- and second-order confirmatory factor analysis (CFA) were performed to evaluate the factor structure of the newly developed Symptom Measurement of Post-Stroke Depression in the Rehabilitation Stage (SMPSD-RS). The reliability and validity of the SMPSD-RS were also verified using several statistical methods. RESULTS: EFA extracted a 24-item, five-factor (cognition, sleep, behavior, emotion, and obsession) model that can clinically explain the symptoms of PSD during the rehabilitation stage. A first-order CFA confirmed the EFA model with good model fit indices, and the second-order CFA further confirmed the five-factor structure model and showed acceptable model fit indices. Acceptable reliability and validity were also achieved by the corresponding indicators. CONCLUSION: The SMPSD-RS was proven to have a stable factor structure and was confirmed to be reliable and valid for assessing PSD symptoms in stroke patients during the rehabilitation stage.

Development and Validation of the Sexual and Negative Dating Inventory (SANDI): A Measure of Dating and Sexual Protective Behaviors.

Adverse sexual experiences are highly prevalent among college students and associated with increased mental health symptoms and decreased use of protective behavioral strategies (PBS). The current study developed and validated a measure of dating and sexual PBS: the Sexual and Negative Dating Inventory (SANDI). Participants (64.28% female, 19.59 [2.90 SD] years old, 68.90% non-Hispanic, 71.42% white, and 76.06% heterosexual) responded to baseline (n = 1,298) and one-month (n = 336) surveys. Exploratory Structural Equation Modeling identified a 24-item measure with five-factors: Location Sharing, Assertiveness, Self-Protection, Risk Reduction, and Privacy. The model revealed good fit: χ2(242) = 2115.52, p < .001, CFI = .977, RMSEA = .077 (90% CI = .074, .080), SRMR = .043. Test-retest reliability revealed acceptable reliability of 0.74 at follow-up. Overall, SANDI showed acceptable reliability and adequate convergent and discriminant validity among college students.

New measures to assess the "Other" three pillars of food security-availability, utilization, and stability.

BACKGROUND: In recent reviews of available measures, no existing measures assessed all four pillars of food security and most only assessed one or two pillars-predominantly the access pillar. The purpose of this study was to preliminarily develop novel measures of availability, utilization, and stability that are complementary to the USDA's household food security survey measure (HFSSM). METHODS: A formative phase included an expert advisory group, literature scans, and interviews with individuals experiencing food insecurity. From April-June 2021, the new measures were piloted in five states (California, Florida, Maryland, North Carolina, and Washington). The cross-sectional pilot survey included the new measures (perceived limited availability, utilization barriers, and food insecurity stability), scales and items for validation (e.g., food security, and self-reported dietary and health outcomes), and demographic questions. Exploratory factor analysis was used to assess dimensionality, internal consistency was assessed using Kuder-Richardson formula 21 (KR21), and convergent and discriminant validity were assessed using Spearman's correlation coefficients. Also, a brief screener version was created for the utilization barriers measure that may be necessary for certain applications (e.g., clinical intake screening to inform referrals to assistance programs). RESULTS: The analytic samples (perceived limited availability (n = 334); utilization barriers (n = 428); food insecurity stability (n = 445)) were around 45 years old on average, most households had children, over two-thirds were food insecure, over three-fourths were women, and the samples were racially/ethnically diverse. All items loaded highly and unambiguously to a factor (factor loadings range 0.525-0.903). Food insecurity stability showed a four-factor structure, utilization barriers showed a two-factor structure, and perceived limited availability showed a two-factor structure. KR21 metrics ranged from 0.72 to 0.84. Higher scores for the new measures were generally associated with increased food insecurity (rhos = 0.248-0.497), except for one of the food insecurity stability scores. Also, several of the measures were associated with statistically significantly worse health and dietary outcomes. CONCLUSIONS: The findings support the reliability and construct validity of these new measures within a largely low-income and food insecure sample of households in the United States. Following further testing, such as Confirmatory Factor Analysis in future samples, these measures may be used in various applications to promote a more comprehensive understanding of the food insecurity experience. Such work can help inform novel intervention approaches to address food insecurity more fully.

Developing a New Generic Health and Wellbeing Measure: Psychometric Survey Results for the EQ-HWB.

OBJECTIVES: The development of measures such as the EQ-HWB (EQ Health and Wellbeing) requires selection of items. This study explored the psychometric performance of candidate items, testing their validity in patients, social carer users, and carers. METHODS: Article and online surveys that included candidate items (N = 64) were conducted in Argentina, Australia, China, Germany, United Kingdom, and the United States. Psychometric assessment on missing data, response distributions, and known group differences was undertaken. Dimensionality was explored using exploratory and confirmatory factor analysis. Poorly fitting items were identified using information functions, and the function of each response category was assessed using category characteristic curves from item response theory (IRT) models. Differential item functioning was tested across key subgroups. RESULTS: There were 4879 respondents (Argentina = 508, Australia = 514, China = 497, Germany = 502, United Kingdom = 1955, United States = 903). Where missing data were allowed, it was low (UK article survey 2.3%; US survey 0.6%). Most items had responses distributed across all levels. Most items could discriminate between groups with known health conditions with moderate to large effect sizes. Items were less able to discriminate across carers. Factor analysis found positive and negative measurement factors alongside the constructs of interest. For most of the countries apart from China, the confirmatory factor analysis model had good fit with some minor modifications. IRT indicated that most items had well-functioning response categories but there was some evidence of differential item functioning in many items. CONCLUSIONS: Items performed well in classical psychometric testing and IRT. This large 6-country collaboration provided evidence to inform item selection for the EQ-HWB measure.

Test anxiety in online exams: scale development and validity.

Considering the increasing use of online tests, this study aims to develop an up-to-date and reliable scale to measure university students' online test anxiety. This study was designed by using mixed research model by combining qualitative and quantitative research methods together. The study consisted of four stages: planning, structuring, quantitative evaluation, reliability and validation. While in the first phase an extensive literature review was conducted, students' opinions were obtained to create an item pool in the second phase. In the third phase, the 29-item scale was administered to 442 university students for factor and reliability analysis. A total of nine items were dropped out from the pool. The Cronbach's alpha value was .98. Exploratory factor analysis revealed that the items loaded on two factors: the psychological and physiological anxiety factor (α = .95), the technical anxiety factor (α = .89). The two-factor solution accounted for more than 63% of the total variance. The final version of the scale was administered to 387 university students for confirmatory factor analysis in the fourth stage. The results proved that the scale had two factors and the fit indices were at an acceptable level. The reliability analysis was run and Cronbach's alpha values were .94 the whole scale, .93 for the psychological and physiological anxiety factor, and .90 for the technical anxiety factor. According to the result, it was concluded that the Test Anxiety Scale for Online Exams is a reliable and valid measurement tool in determining university students' online test anxiety. Finally, recommendations for future research are provided.

Registered report: Initial development and validation of the eating disorders safety behavior scale.

Anxiety and eating disorders (EDs) often co-occur, prompting calls to explore anxiety-related maintenance processes in ED samples. Safety behaviors, which function to prevent a feared outcome from occurring or to reduce anxiety associated with a feared stimulus, are observed across anxiety disorders and, along with overt avoidance behaviors, are an important target in treatment. Data suggest that individuals with EDs also engage in safety behaviors. However, no existing assessments provide a comprehensive measure of eating-disorder-specific overt avoidance and safety behaviors. The goal of this Stage 1 Registered Report is to develop a comprehensive self-report measure of ED-specific safety behaviors. In Study 1, we will recruit 50 women with EDs to complete the scale and provide feedback on the response scale. Feedback from these participants will be used to refine the measure. In Study 2, we will evaluate the psychometric properties of the measure in a large sample of women with EDs (n dependent on the size of measurement) and a community sample without current or a history of ED symptoms. We will explore the measure factor structure, known-groups validity by comparing scores from women with EDs to healthy controls, internal consistency, and convergent and divergent validity with other psychological instruments.

Development of a support for Black Lives Matter measure among racially-ethnically diverse college students.

This paper developed and validated a new measure of support for the Black Lives Matter (BLM) movement among a racially-ethnically diverse sample of college students. The measure focuses on the movement's principles of Black liberation, intersectionality, and alliance building. Participants included 1934 college students (75% female) from a large public Southwestern university. The factor structure was supported by exploratory and confirmatory factor analyses, resulting in an 18-item measure, Support for Black Lives Matter, with two underlying factors. Black Liberation includes 12 items representing support for BLM because of awareness of and challenging structural inequality and racism experienced by Black individuals. Intersectional Values includes six items representing support for BLM because it embraces and affirms marginalized populations within the Black community, especially disabled Blacks, queer Blacks, Black women, and Black families with children. Evidence of criterion-related validity was demonstrated with racial group differences in support of BLM factors. Evidence of convergent validity was supported by significant positive correlations between support for BLM factors and critical consciousness (including awareness of racism, classism, and heterosexism), and negative correlations between support for BLM factors and subtle racist attitudes toward Blacks. Measurement invariance was evident between White, Black, Asian American, Latinx, and Multiracial participants. Implications and suggestions for use of the new measure are discussed.

Psychometric Properties of the Assessment of Recovery Capital (ARC) Instrument in a Diverse Low-Income Sample.

Background: Recovery capital is a theoretical construct elucidating the resources that support recovery from addiction. The 50-item Assessment of Recovery Capital (ARC) instrument and related brief-format versions are the predominant measures of this construct. However, some of the ARC's psychometric properties are not well-established, particularly in racially and economically diverse populations. Objectives: We aimed to determine if the ARC is a valid and reliable measure of recovery capital in a diverse sample. Methods: Paper-and-pencil survey data were collected between March 2017 and May 2018 from a low-income, racially diverse sample of adults in recovery (N = 273). Participants were recruited from nontreatment community settings throughout a mid-sized northeastern U.S. city. They completed the ARC and sociodemographic questions. To determine the ARC's reliability and factor structure, we used item-level analyses and Cronbach's alpha, followed by confirmatory and exploratory factor analyses. Results: Several items performed poorly, having means close to response extremes and problematically small variances. Cronbach's alpha for the full measure was α = .92; however, alphas for the majority of subscales were below .70. The a priori 10-factor model solution failed, preventing interpretation of the confirmatory factor analysis results. Exploratory factor analysis revealed that although the 10-factor model marginally fit the data, items did not load together as proposed. Not once did all five subscale items load highly on the same factor. Conclusions/Importance: The ARC has substantial weaknesses in its theoretical alignment, item performance, and psychometric properties with diverse populations. We recommend the development of a new multidimensional, theory-aligned measure, following a rigorous measurement development protocol.

A qualitative study investigating the meaning of participation to improve the measurement of this construct.

PURPOSE: The purpose of this study was to improve the measurement of participation. Research questions were as follows: (1) What constitutes participation according to adults? (2) Do they mention participation subdomains that are not covered in the Patient-Reported Outcomes Measurement Information System (PROMIS) item bank "Ability to Participate in Social Roles and Activities"? METHODS: Semi-structured interviews were conducted with 46 adults from the general population. Interviews were thematically analysed using the International Classification of Functioning, Disability and Health (ICF) as conceptual framework. Thereafter, assigned codes were compared to PROMIS item bank. RESULTS: Participants mentioned a variety of participation subdomains that were meaningful to them, such as socializing and employment. All subdomains could be classified into the ICF. The following subdomains were not covered by the PROMIS item bank: acquisition of necessities, education life, economic life, community life, and religion and spirituality. Also a distinction between remunerative (i.e. paid) and non-remunerative (i.e. unpaid) employment, and domestic life was missing. Several ICF sub-codes were not mentioned, such as ceremonies. CONCLUSIONS: Many participation subdomains were mentioned to be meaningful. As several of these subdomains are not covered in the PROMIS item bank, it may benefit from extension with new (patient-)reported subdomains of participation.

Validity of a streamlined version of the Focus on the Outcomes of Communication Under Six: Process and outcome.

BACKGROUND: The Focus on the Outcomes of Communication Under Six (FOCUS) is a 50-item outcome measure based on the framework and concepts of World Health Organization's International Classification of Functioning. The FOCUS has been shown to capture participation-level changes associated with speech and language therapy in children 18 to 72 months old and has established validity and reliability. However, there were reasons to try to reduce the measure without losing any of its proven value as a change-detecting instrument. METHODS: Using data from 18,931 preschool children, we used item response models and a test of redundancy to reduce the original 50-item FOCUS to 34 items. We then assessed the correlations between FOCUS-50 and FOCUS-34 scores on these children. RESULTS: Findings show that a shortened (34-item) version of FOCUS can be treated as equivalent to the full 50-item version. CONCLUSION: The correlation between change scores on the two versions is .98. We suggest that in situations where only a total score is of interest, the FOCUS-34 can be used in place of the full FOCUS.

Development of a tool for the evaluation of obesity prevention partnerships.

ISSUE ADDRESSED: Working in partnership is advocated as a necessary process to achieve shared goals in complex policy areas, yet little effort is dedicated to evaluating how well partnerships are functioning. This study describes the development and psychometric properties of a partnership assessment tool and illustrates its use in an obesity prevention partnership. METHODS: A literature scoping review was conducted on existing partnership assessment tools and used to develop a new tool, which was tested using the ACT whole-of-government Healthy Weight Initiative at two timepoints. The psychometric properties of the tool were evaluated using principal component analysis and Cronbach's alpha for internal consistency of domain subscales. RESULTS: The review identified 11 partnership assessment tools, from which we identified five domains of partnership to develop the new tool. Factor analysis showed each domain yielded a single subscale. Cronbach's alpha for each of the domain subscales ranged between 0.88 and 0.94 at Timepoint 1 and 0.90 and 0.95 at Timepoint 2 demonstrating very high internal consistency. All subscales demonstrated high correlation with an overall partnership rating, good internal consistency and concordance with issues raised in open-ended questions. CONCLUSION: This paper describes the development and implementation of a tool to evaluate partnership functioning, which was found to have high internal consistency and reliability. SO WHAT?: With increasing emphasis on working in partnership, using partnership assessment tools can provide useful evidence to assess whether partnerships are a successful strategy in complex programs evaluation.

Towards a measure of accountability in nursing: A three-stage validation study.

AIMS: The aim of this study was to develop and psychometrically evaluate a three-dimensional questionnaire suitable for evaluating personal and organizational accountability in nurses. BACKGROUND: Accountability is defined as a three-dimensional value, directing professionals to take responsibility for their decisions and actions, to be willing to explain them (transparency), and to be judged according to society's accepted values (answerability). Despite the relatively clear definition, measurement of accountability lags well behind. Existing self-report questionnaires do not fully capture the complexity of the concept nor do they capture the different sources of accountability (e.g., personal accountability, organizational accountability). DESIGN: A three-stage measure development. METHODS: Data were collected during 2015-2016. In Phase 1, an initial database of items (N = 74) was developed, based on literature review and qualitative study, establishing face and content validity. In Phase 2, the face, content, construct, and criterion-related validity of the initial questionnaires (19 items for personal and organizational accountability questionnaire) were established with a sample of 229 nurses. In Phase 3, the final questionnaires (19 items each) were validated with a new sample of 329 nurses and established construct validity. RESULTS: The final version of the instruments comprised 19 items, suitable for assessing personal and organizational accountability. The questionnaire referred to the dimensions of responsibility, transparency, and answerability. The findings established the instrument's content, construct, and criterion-related validity as well as good internal reliability. CONCLUSION: The questionnaire portrays accountability in nursing, by capturing nurses' subjective perceptions of accountability dimensions (responsibility, transparency, answerability), as demonstrated by personal and organizational values.

Cultural adaptation of a supportive care needs measure for Hispanic men cancer survivors.

OBJECTIVE: Research with ethnic minority populations requires instrumentation that is cultural and linguistically relevant. The aim of this study was to translate and culturally adapt the Cancer Survivor Unmet Needs measure into Spanish. METHODS: We describe the iterative, community-engaged consensus-building approaches used to adapt the instrument for Hispanic male cancer survivors. We used an exploratory sequential mixed method study design. Methods included translation and back-translation, focus groups with cancer survivors (n = 18) and providers (n = 5), use of cognitive interview techniques to evaluate the comprehension and acceptability of the adapted instrument with survivors (n = 12), ongoing input from the project's community advisory board, and preliminary psychometric analysis (n = 84). RESULTS: The process emphasized conceptual, content, semantic, and technical equivalence. Combining qualitative and quantitative approaches offered a rigorous, systematic, and contextual approach to translation alone and supports the cultural adaptation of this measure in a purposeful and relevant manner. CONCLUSION: Our findings highlight the importance of going beyond translation when adapting measures for cross-cultural populations and illustrate the importance of taking culture, literacy, and language into consideration.

Using spontaneous commentary of nursing home residents to develop resident-centered measurement tools: A case study.

Nursing home (NH) residents routinely complete surveys that assess their health, well-being, preferences, and care needs. Such surveys reveal important information, however, are largely based on the concerns of providers as opposed to the concerns of residents. Thus, researchers must enhance efforts to ensure that these surveys are guided by the priorities, needs, and concerns of residents. We present a case study to demonstrate how spontaneous commentary of NH residents holds particular efficacy for ensuring that measurement tools are guided by the needs, concerns, and priorities of residents. Spontaneous comments from NH residents (N = 370) collected as part of a study developing the Preferences for Everyday Living Inventory for NH residents (PELI-NH) were used to refine the PELI-NH across key phases of measurement development. This work demonstrates how the spontaneous commentary of NH residents may contribute to the refinement of NH measurement tools, and allow researchers to base these tools on the needs and priorities of NH residents.

Psychosocial work characteristics of personal care and service occupations: a process for developing meaningful measures for a multiethnic workforce.

BACKGROUND AND OBJECTIVES: Despite their rapid increase in number, workers in personal care and service occupations are underrepresented in research on psychosocial work characteristics and occupational health. Some of the research challenges stem from the high proportion of immigrants in these occupations. Language barriers, low literacy, and cultural differences as well as their nontraditional work setting (i.e., providing service for one person in his/her home) make generic questionnaire measures inadequate for capturing salient aspects of personal care and service work. This study presents strategies for (1) identifying psychosocial work characteristics of home care workers that may affect their occupational safety and health and (2) creating survey measures that overcome barriers posed by language, low literacy, and cultural differences. DESIGN AND RESULTS: We pursued these aims in four phases: (Phase 1) Six focus groups to identify the psychosocial work characteristics affecting the home care workers' occupational safety and health; (Phase 2) Selection of questionnaire items (i.e., questions or statements to assess the target construct) and first round of cognitive interviews (n = 30) to refine the items in an iterative process; (Phase 3) Item revision and second round of cognitive interviews (n = 11); (Phase 4) Quantitative pilot test to ensure the scales' reliability and validity across three language groups (English, Spanish, and Chinese; total n = 404). Analysis of the data from each phase informed the nature of subsequent phases. This iterative process ensured that survey measures not only met the reliability and validity criteria across groups, but were also meaningful to home care workers. CONCLUSION: This complex process is necessary when conducting research with nontraditional and multilingual worker populations.

Measuring leadership in sport: Development and validation of the Identity Leadership Inventory - Youth (ILI-Y).

The social identity approach to leadership posits that leaders' effectiveness depends on their ability to represent, advance, create, and embed a shared sense of social identity among their followers. Although significant progress has been made in investigating the benefits of identity leadership in adult sports, research in youth sports is still in its infancy. One reason is the lack of a youth-centric inventory that adequately measures identity leadership in this population. To bridge this gap, we developed and validated a long (16 items) and short (5 items) version of the Identity Leadership Inventory for Youth Sport (ILI-Y or ILI-Y-Short-Form) through five studies conducted in three phases of research. Data were primarily collected in football in the United Kingdom, involving a total of 1096 participants. Results of Phase I of this study provided little to no evidence that the ILI - originally developed for adults - was understandable (Study 1) and had factor validity and internal consistency (Study 2) in a sample of youth athletes. Therefore, in Phase II, the ILI was revised, leading to the development of the ILI-Y, which was understandable for youth athletes (Study 3). Results from Phase II (Study 4) also indicated that the ILI-Y exhibited a unidimensional factor structure, which was subsequently confirmed in Phase III (Study 5). This last phase offered additional evidence for the discriminant, criterion, and incremental validity of the ILI-Y and its short form, along with their measurement invariance across genders and age groups, and internal consistency. This study provides sports psychology researchers and practitioners with a valid measure to assess identity leadership in youth sports.

An Initial Psychometric Evaluation of a Novel Upper Extremity Pediatric Stroke Hemiplegic Motor Impairment Scale.

BACKGROUND: Our team designed an innovative, observation-based motor impairment measure-the Pediatric Stroke Hemiplegic Motor Impairment Scale (Pedi HEMIs). Here we present the results of a survey describing common practices in the pediatric stroke community and the initial psychometric properties of the upper extremity subscale of the Pedi HEMIs (Pedi HEMIs-UE). METHODS: This is a cross-sectional study whereby participants completed a battery of assessments including the novel Pedi HEMIs-UE. Internal consistency was measured via Cronbach alpha (α). Intraclass correlation (ICC) was used to assess inter-rater reliability (IRR). Concurrent validity was investigated using Pearson or polychoric correlations and simple linear regressions. RESULTS: The study sample consisted of 18 children aged 1.08 to 15 years. Two participants completed two sets of evaluations, totaling 20 data sets. Cronbach α, a measure of internal consistency, was on average 0.91 (range: 0.89 to 0.92). IRR was excellent with the six raters in almost perfect agreement (ICC = 0.91; 95% confidence interval [CI]: 0.83 to 0.96). Pearson correlation coefficient between the Pedi HEMIs-UE and logit Assisting Hand Assessment (AHA)/mini-AHA was -0.938 (95% CI: -0.979 to -0.827, P < 0.001), indicating excellent concurrent validity. CONCLUSIONS: We found excellent feasibility, reliability, and validity of the Pedi HEMIs-UE in a convenience sample of youth with hemiparesis after stroke.

Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT).

BACKGROUND: Although significant advances have been made in the conceptualization of sustainability, having pragmatic, psychometrically valid tools remains a need within the field. Our previous work has developed frameworks and tools to assess both program sustainability and clinical sustainability capacity. This work presents new, psychometrically tested short versions of the Program Sustainability Assessment Tool (PSAT) and the Clinical Sustainability Assessment Tool (CSAT). METHODS: These methods were conducted in identical, parallel processes for the CSAT and PSAT. Previously collected data for these instruments was obtained across a variety of settings, contexts, and participants. We first conducted testing to determine cronbach's alpha of shortened domains (3 items each) and then conducted Confirmatory Factor Analysis to ensure that the domains were still appropriate for the tool. After, the team met to review the results and determine the final versions of the short PSAT and short CSAT. RESULTS: The short PSAT retained cronbach's alpha's of 0.82 - 0.91 for each domain of the tool, with which maintains excellent reliability for the tool. Confirmatory factor analysis highlights that the short PSAT retains conceptual distinction across the 8 domains, with CFI scores greater than 0.90, RMSEA scores below 0.6, and SRMR scores less than 0.08. The short CSAT had cronbach's alpha of 0.84 - 0.92 for each of the domains of the tool, also suggesting excellent reliability of the domains within the measure after dropping two items/domain. Confirmatory factor analysis of the short CSAT meets the same specifications as above, again highlighting conceptual distinction across the domains. CONCLUSION: Each tool was able to be shortened to three items per domain while maintaining strong psychometric properties. This results in a tool that takes less time to complete, meeting one of the key calls for pragmatic measures within implementation science. This advances our abilities to measure and test sustainability within implementation science.

A case study of pragmatic measure development of the Treatment Integrity for Elementary Settings self-report measure for teachers.

Introduction: Due to usability, feasibility, and acceptability concerns, observational treatment fidelity measures are often challenging to deploy in schools. Teacher self-report fidelity measures with specific design features might address some of these barriers. This case study outlines a community-engaged, iterative process to adapt the observational Treatment Integrity for Elementary Settings (TIES-O) to a teacher self-report version designed to assess the use of practices to support children's social-emotional competencies in elementary classrooms. Method: Cognitive walkthrough interviews were conducted with teachers to improve the usability of the teacher self-report measure, called the Treatment Integrity for Elementary Schools-Teacher Report (TIES-T). Qualitative content analysis was used to extract themes from the interviews and inform changes to the measure. Results: Increasing clarity and interactive elements in the measure training were the dominant themes, but suggestions for the measure format and jargon were also suggested. Conclusion: The suggested changes resulted in a brief measure, training, and feedback system designed to support the teacher's use of practices to support children's social-emotional competencies in elementary classrooms. Future research with the TIES-T will examine the score reliability and validity of the measure.

Collecting observational data in schools is challenging, so developing teacher self-report measures and involving teachers in the design process is important to help make them easier to use. This paper reports on the development of a teacher self-report measure designed to collect information about the instructional practices teachers deliver to promote positive student behavior.