Learning Health Systems Research Competencies: A Survey of the Rehabilitation Research Community.

OBJECTIVE: The Learning Health Systems Rehabilitation Research Network (LeaRRn), an NIH-funded rehabilitation research resource center, aims to advance the research capacity of learning health systems (LHSs) within the rehabilitation community. A needs assessment survey was administered to inform development of educational resources. METHODS: The online survey included 55 items addressing interest in and knowledge of 33 LHS research core competencies in 7 domains and additional items on respondent characteristics. Recruitment targeting rehabilitation researchers and health system collaborators was conducted by LeaRRn, LeaRRn health system partners, rehabilitation professional organizations, and research university program directors using email, listservs, and social media announcements. RESULTS: Of the 650 people who initiated the survey, 410 respondents constituted the study sample. Respondents indicated interest in LHS research and responded to at least 1 competency item and/or demographic question. Two-thirds of the study sample had doctoral research degrees, and one-third reported research as their profession. The most common clinical disciplines were physical therapy (38%), communication sciences and disorders (22%), and occupational therapy (10%). Across all 55 competency items, 95% of respondents expressed "a lot" or "some" interest in learning more, but only 19% reported "a lot" of knowledge. Respondents reported "a lot" of interest in a range of topics, including selecting outcome measures that are meaningful to patients (78%) and implementing research evidence in health systems (75%). "None" or "some" knowledge was reported most often in Systems Science areas such as understanding the interrelationships between financing, organization, delivery, and rehabilitation outcomes (93%) and assessing the extent to which research activities will improve the equity of health systems (93%). CONCLUSION: Results from this large survey of the rehabilitation research community indicate strong interest in LHS research competencies and opportunities to advance skills and training. IMPACT: Competencies where respondents indicated high interest and limited knowledge can inform development of LHS educational content that is most needed.

Linking job duties, functioning, and employment status using the Work-Disability Functional Assessment Battery (WD-FAB): An expert coding and quantitative analysis.

BACKGROUND: An understanding of the link between specific occupational demands and individual worker functioning is limited, although such information could permit an assessment of the fit between the two in a manner that would inform national and state disability programs such as vocational rehabilitation and Social Security disability programs. OBJECTIVE: Our goal was to examine the utility of assessing physical and mental functioning relative to self-reported job duties to identify the domains of worker functioning most likely to create barriers to fulfilling an occupation's specific requirements. METHODS: Through primary survey data collection, 1770 participants completed the Work-Disability Functional Assessment Battery (WD-FAB) instrument after reporting details on their occupations (or most recent occupation if not working). Expert coders evaluated the level of function expected to successfully carry out each self-reported job duty with respect to six scales of physical and mental function. Quantitative analysis is used to examine the relationship between functioning and job duties. RESULTS: Those not working due to disability were more likely to fall short of the threshold of the physical and mental functioning requirements of their last job's three main job duties compared to those currently employed. Mental function scales were most likely to be the area experiencing a shortfall. CONCLUSIONS: Functional difficulties impede the ability to continue working in particular jobs that require that ability. This points to a need for specific accommodations to be implemented to bridge the gap between job requirements and functional capacity so that workers may remain engaged in their current work.

The Development of a Crosswalk for Functional Measures in Postacute Medicare Claims.

OBJECTIVE: Although Medicare assessment files will include Standardized Patient Assessment Data Elements from 2016 forward, lack of uniformity of functional data prior to 2016 impedes longitudinal research. The purpose of this study was to create crosswalks for postacute care assessment measures and the basic mobility and daily activities scales of the Activity Measure for Post-Acute Care (AM-PAC) and to test their accuracy and validity in development and validation datasets. METHODS: This cross-sectional study is a secondary analysis of AM-PAC, the Inpatient Rehabilitation Facility Patient Assessment Instrument, the Minimum Data Set, and the Outcome and Assessment Information Set data from 300 adults receiving rehabilitation recruited from 6 health care networks in 1 metropolitan area. Rasch analysis was used to co-calibrate items from the 3 measures onto the AM-PAC metric and to create look-up tables to create estimated AM-PAC (eAM-PAC) scores. Mean scores and correlation and agreement between actual and estimated scores were examined in the development dataset. Scores were estimated in a cohort of Medicare beneficiaries with hip, humerus and radius fractures. Correlations between eAM-PAC and Functional Independence Measure motor scores were examined. Differences in mean eAM-PAC scores were evaluated across groups of known differences (age, fracture type, dementia). RESULTS: Strong correlations were found between actual and eAM-PAC scores in the development dataset. Moderate to strong correlations were found between the eAM-PAC basic mobility and Functional Independence Measure motor scores in the validation dataset. Differences in basic mobility scores across known groups were statistically significant and appeared to be clinically important. Differences between mean daily activities scores were statistically significant but appeared not to be clinically important. CONCLUSION: Although further testing is warranted, the basic mobility crosswalk appears to provide valid scores for aggregate analysis of Medicare postacute care data. IMPACT: This study reports on a method to take data from different Medicare administrative data sources and estimate scores on 1 scale. This approach was applied separately for data related to basic mobility and to daily activities. This may allow researchers to overcome challenges with using Medicare administrative data from different sources.

Unrestricted Direct Access to Physical Therapist Services Is Associated With Lower Health Care Utilization and Costs in Patients With New-Onset Low Back Pain.

BACKGROUND: Low back pain (LBP) is one of the most prevalent conditions for which patients seek physical therapy in the United States. The American Physical Therapy Association categorizes direct access to physical therapist services into 3 levels: limited, provisional, and unrestricted. OBJECTIVE: The objective of this study was to evaluate the association of level of access to physical therapist services with LBP-related health care utilization and costs. DESIGN: This was a retrospective cohort study of patients with new-onset LBP between 2008 and 2013; data were from OptumLabs Data Warehouse. METHODS: We identified 59,670 individuals who were 18 years old or older, who had new-onset LBP, and who had commercial or Medicare Advantage insurance through a private health plan. We examined 2 samples. The first was health care utilization among individuals who saw a physical therapist first in states with either unrestricted access or provisional access. The second was LBP-related costs among individuals who saw either a physical therapist or a primary care physician first. RESULTS: Individuals who saw a physical therapist first in states with provisional access had significantly higher measures of health care utilization within 30 days, including plain imaging and frequency of physician visits, than individuals who saw a physical therapist first in states with unrestricted access. Compared with individuals who saw a primary care physician first, pooled across provisional-access and unrestricted-access states, those who saw a physical therapist first in provisional-access states had 25% higher relative costs at 30 days and 32% higher relative costs at 90 days, whereas those who saw a physical therapist first in unrestricted-access states had 13% lower costs at 30 days and 32% lower costs at 90 days. LIMITATIONS: This was a claims-based study with limited information on patient characteristics, including severity and duration of pain. CONCLUSIONS: Short-term LBP-related health care utilization and costs were lower for individuals in unrestricted-access states than in provisional-access states.

Psychometric Evaluation of the Improved Work-Disability Functional Assessment Battery.

OBJECTIVE: To assess psychometric properties of the improved Work Disability Functional Assessment Battery (WD-FAB 2.0). DESIGN: Longitudinal study. SETTING: Community. PARTICIPANTS: Three samples of working-age (21-66) adults (N=1006): (1) unable to work because of a physical condition (n=375); (2) unable to work because of a mental health condition (n=296); (3) general United States working age sample (n=335). INTERVENTION: NA. MAIN OUTCOME MEASURES: All samples completed the WD-FAB 2.0; the second administration came 5 days after the first. Construct validity was examined by convergent and divergent correlational analysis using legacy measures. Test-retest reliability was assessed by intraclass correlation coefficients (ICC3,1). Standard error of the mean (SEM) and minimal detectable change (MDC90) were calculated to measure scale precision and sensitivity. RESULTS: Physical function ICCs ranged from 0.69 to 0.77 in the general sample, and 0.66 to 0.86 in the disability sample. Mental health function scales ICCs ranged from 0.62 to 0.73 in the general sample, and 0.74 to 0.76 in the disability sample. SEMs for all scales indicated good discrimination; those for the physical function scales were generally lower than those for the mental health scales. MDC90 values ranged from 3.41 to 10.55. Correlations between all WD-FAB 2.0 scales and legacy measures were in the expected direction. CONCLUSIONS: The study provides substantial support for the reliability and construct validity of the WD-FAB 2.0 among 3 diverse samples. Although initially developed for use within the Social Security Administration (SSA), these results suggest that the WD-FAB 2.0 could be used for assessment and measurement of work-related physical and mental health function in other contexts as well.

Validation of the Work-Disability Physical Functional Assessment Battery.

OBJECTIVE: To examine the validity of the self-report Work-Disability Functional Assessment Battery (WD-FAB) physical function scales relative to clinician ratings of function and a performance-based functional capacity evaluation called the Physical Work Performance Evaluation (PWPE). DESIGN: Cross-sectional. SETTING: Outpatient rehabilitation. PARTICIPANTS: Adults (N=50) participating in physical therapy for musculoskeletal conditions. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Patients completed the PWPE and the WD-FAB physical function scales including Changing and Maintaining Body Position, Whole Body Mobility, Upper Body Function, and Upper Extremity Fine Motor. The physical therapist also answered the WD-FAB questions on the patient's physical functioning. The WD-FAB computer-adaptive test version administered up to 10 items for each scale. The PWPE produces ratings from 0 to 5 indicating overall Level of Work ability: 0 (unable to work); 1 (sedentary); 2 (light); 3 (medium); 4 (heavy); 5 (very heavy). The PWPE also produces Level of Work ability ratings in the Dynamic Strength, Position Tolerance, and Mobility subsections. RESULTS: Participating in the study were 50 patients with 1 or more conditions (shoulder, n=21; knee, n=16; low back, n=13; ankle/foot, n=10; neck, n=8; hip, n=7). The patient-based WD-FAB scores demonstrated moderate, statistically significant correlations with the provider proxy WD-FAB report (R=.49-.65). The WD-FAB Upper Body Function scale scores demonstrated moderate strength relationships with the PWPE overall ratings. The Whole Body Mobility and Changing and Maintaining Body Position scales did not demonstrate statistically significant relationships with the PWPE overall ratings. CONCLUSIONS: We found moderate evidence for validity for the WD-FAB Upper Body Function, Whole Body Mobility, and Changing and Maintaining Body Position scales relative to clinician report and varied evidence relative to the PWPE in this clinical sample.

Promoting innovation: Enhancing transdisciplinary opportunities for medical and engineering students.

PURPOSE: Addressing current healthcare challenges requires innovation and collaboration. Current literature provides limited guidance in promoting these skills in medical school. One approach involves transdisciplinary training in which students from different disciplines work together toward a shared goal. We assessed the need for such a curriculum at Dartmouth College. METHODS: We surveyed medical and engineering students' educational values; learning experiences; professional goals; and interest in transdisciplinary education and innovation. Data were analyzed using descriptive statistics. RESULTS: Shared values among student groups included leadership development, innovation, collaboration, and resource sharing. Medical students felt their curriculum inadequately addressed creativity and innovation relative to their engineering counterparts (p < 0.05). Medical students felt less prepared for entrepreneurial activities (p < 0.05), while engineering students indicated a need for basic medical knowledge and patient-oriented design factors. Despite strong interest, collaboration was less than 50% of indicated interest. CONCLUSIONS: Medical and engineering students share an interest in the innovation process and need a shared curriculum to facilitate collaboration. A transdisciplinary course that familiarizes students with this process has the potential to promote physicians and engineers as leaders and innovators who can effectively work across industry lines. A transdisciplinary course was piloted in Spring 2017.

Falling Down on the Job: Evaluation and Treatment of Fall Risk Among Older Adults With Upper Extremity Fragility Fractures.

Background: Clinical practice guidelines recommend fall risk assessment and intervention for older adults who sustain a fall-related injury to prevent future injury and mobility decline. Objective: The aim of this study was to describe how often Medicare beneficiaries with upper extremity fracture receive evaluation and treatment for fall risk. Design: Observational cohort. Methods: Participants were fee-for-service beneficiaries age 66 to 99 treated as outpatients for proximal humerus or distal radius/ulna ("wrist") fragility fractures. -Participants were studied using Carrier and Outpatient Hospital files. The proportion of patients evaluated or treated for fall risk up to 6 months after proximal humerus or wrist fracture from 2007-2009 was examined based on evaluation, treatment, and diagnosis codes. Time to evaluation and number of treatment sessions were calculated. Logistic regression was used to analyze patient characteristics that predicted receiving evaluation or treatment. Narrow (gait training) and broad (gait training or therapeutic exercise) definitions of service were used. Results: There were 309,947 beneficiaries who sustained proximal humerus (32%) or wrist fracture (68%); 10.7% received evaluation or treatment for fall risk or gait issues (humerus: 14.2%; wrist: 9.0%). Using the broader definition, the percentage increased to 18.5% (humerus: 23.4%; wrist: 16.3%). Factors associated with higher likelihood of services after fracture were: evaluation or treatment for falls or gait prior to fracture, more comorbidities, prior nursing home stay, older age, humerus fracture (vs wrist), female sex, and white race. Limitations: Claims analysis may underestimate physician and physical therapist fall assessments, but it is not likely to qualitatively change the results. Conclusions: A small proportion of older adults with upper extremity fracture received fall risk assessment and treatment. Providers and health systems must advance efforts to provide timely evidence-based management of fall risk in this population.

Improving measures of work-related physical functioning.

PURPOSE: To expand content of the physical function domain of the Work Disability Functional Assessment Battery (WD-FAB), developed for the US Social Security Administration's (SSA) disability determination process. METHODS: Newly developed questions were administered to 3532 recent SSA applicants for work disability benefits and 2025 US adults. Factor analyses and item response theory (IRT) methods were used to calibrate and link the new items to the existing WD-FAB, and computer-adaptive test simulations were conducted. RESULTS: Factor and IRT analyses supported integration of 44 new items into three existing WD-FAB scales and the addition of a new 11-item scale (Community Mobility). The final physical function domain consisting of: Basic Mobility (56 items), Upper Body Function (34 items), Fine Motor Function (45 items), and Community Mobility (11 items) demonstrated acceptable psychometric properties. CONCLUSIONS: The WD-FAB offers an important tool for enhancement of work disability determination. The FAB could provide relevant information about work-related functioning for initial assessment of claimants; identifying denied applicants who may benefit from interventions to improve work and health outcomes; enhancing periodic review of work disability beneficiaries; and assessing outcomes for policies, programs and services targeting people with work disability.

Cost-utility of cognitive behavioral therapy for low back pain from the commercial payer perspective.

STUDY DESIGN: Markov cost-utility model. OBJECTIVE: To evaluate the cost-utility of cognitive behavioral therapy (CBT) for the treatment of persistent nonspecific low back pain (LBP) from the perspective of US commercial payers. SUMMARY OF BACKGROUND DATA: CBT is widely deemed clinically effective for LBP treatment. The evidence is suggestive of cost-effectiveness. METHODS: We constructed and validated a Markov intention-to-treat model to estimate the cost-utility of CBT, with 1-year and 10-year time horizons. We applied likelihood of improvement and utilities from a randomized controlled trial assessing CBT to treat LBP. The trial randomized subjects to treatment but subjects freely sought health care services. We derived the cost of equivalent rates and types of services from US commercial claims for LBP for a similar population. For the 10-year estimates, we derived recurrence rates from the literature. The base case included medical and pharmaceutical services and assumed gradual loss of skill in applying CBT techniques. Sensitivity analyses assessed the distribution of service utilization, utility values, and rate of LBP recurrence. We compared health plan designs. Results are based on 5000 iterations of each model and expressed as an incremental cost per quality-adjusted life-year. RESULTS: The incremental cost-utility of CBT was $7197 per quality-adjusted life-year in the first year and $5855 per quality-adjusted life-year over 10 years. The results are robust across numerous sensitivity analyses. No change of parameter estimate resulted in a difference of more than 7% from the base case for either time horizon. Including chiropractic and/or acupuncture care did not substantively affect cost-effectiveness. The model with medical but no pharmaceutical costs was more cost-effective ($5238 for 1 yr and $3849 for 10 yr). CONCLUSION: CBT is a cost-effective approach to manage chronic LBP among commercial health plans members. Cost-effectiveness is demonstrated for multiple plan designs. LEVEL OF EVIDENCE: 2.

Work-related measures of physical and behavioral health function: Test-retest reliability.

BACKGROUND: The Work Disability Functional Assessment Battery (WD-FAB), developed for potential use by the US Social Security Administration to assess work-related function, currently consists of five multi-item scales assessing physical function and four multi-item scales assessing behavioral health function; the WD-FAB scales are administered as Computerized Adaptive Tests (CATs). OBJECTIVE: The goal of this study was to evaluate the test-retest reliability of the WD-FAB Physical Function and Behavioral Health CATs. METHODS: We administered the WD-FAB scales twice, 7-10 days apart, to a sample of 376 working age adults and 316 adults with work-disability. Intraclass correlation coefficients were calculated to measure the consistency of the scores between the two administrations. Standard error of measurement (SEM) and minimal detectable change (MDC90) were also calculated to measure the scales precision and sensitivity. RESULTS: For the Physical Function CAT scales, the ICCs ranged from 0.76 to 0.89 in the working age adult sample, and 0.77-0.86 in the sample of adults with work-disability. ICCs for the Behavioral Health CAT scales ranged from 0.66 to 0.70 in the working age adult sample, and 0.77-0.80 in the adults with work-disability. The SEM ranged from 3.25 to 4.55 for the Physical Function scales and 5.27-6.97 for the Behavioral Health function scales. For all scales in both samples, the MDC90 ranged from 7.58 to 16.27. CONCLUSION: Both the Physical Function and Behavioral Health CATs of the WD-FAB demonstrated good test-retest reliability in adults with work-disability and general adult samples, a critical requirement for assessing work related functioning in disability applicants and in other contexts.

Work disability functional assessment battery: feasibility and psychometric properties.

OBJECTIVE: To assess the feasibility and psychometric properties of 8 scales covering 2 domains of the newly developed Work Disability Functional Assessment Battery (WD-FAB): physical function (PF) and behavioral health (BH) function. DESIGN: Cross-sectional study. SETTING: Community. PARTICIPANTS: Adults (N=973) unable to work because of a physical (n=497) or a mental (n=476) disability. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Each disability group responded to a survey consisting of the relevant WD-FAB scales and existing measures of established validity. The WD-FAB scales were evaluated with regard to data quality (score distribution, percentage of "I don't know" responses), efficiency of administration (number of items required to achieve reliability criterion, time required to complete the scale) by computerized adaptive testing (CAT), and measurement accuracy as tested by person fit. Construct validity was assessed by examining both convergent and discriminant correlations between the WD-FAB scales and scores on same-domain and cross-domain established measures. RESULTS: Data quality was good, and CAT efficiency was high across both WD-FAB domains. Measurement accuracy was very good for PF scales; BH scales demonstrated more variability. Construct validity correlations, both convergent and divergent, between all WD-FAB scales and established measures were in the expected direction and range of magnitude. CONCLUSIONS: The data quality, CAT efficiency, person fit, and construct validity of the WD-FAB scales were well supported and suggest that the WD-FAB could be used to assess PF and BH function related to work disability. Variation in scale performance suggests the need for future work on item replenishment and refinement, particularly with regard to the Self-Efficacy scale.

Clinical outcomes assessment in clinical trials to assess treatment of femoroacetabular impingement: use of patient-reported outcome measures.

Patient-reported outcome measures are an important component of outcomes assessment in clinical trials to assess the treatment of femoroacetabular impingement (FAI). This review of disease-specific measures and instruments used to assess the generic quality of life and physical activity levels of patients with FAI found no conclusive evidence to support a single disease-specific questionnaire. Using a systematic review of study methodology, the Copenhagen Hip and Groin Outcome Score and the 33-item International Hip Outcome Tool scored the best. Nevertheless, both of these instruments were developed recently and have not been established in the literature. Although currently used generic and activity-level measures have limitations, as well, they should be considered, depending on the specific goals of the study. Additional research is needed to assess the properties of these measures fully when used to evaluate patients with FAI.

Development of a computer-adaptive physical function instrument for Social Security Administration disability determination.

OBJECTIVES: To develop and test an instrument to assess physical function for Social Security Administration (SSA) disability programs, the SSA-Physical Function (SSA-PF) instrument. Item response theory (IRT) analyses were used to (1) create a calibrated item bank for each of the factors identified in prior factor analyses, (2) assess the fit of the items within each scale, (3) develop separate computer-adaptive testing (CAT) instruments for each scale, and (4) conduct initial psychometric testing. DESIGN: Cross-sectional data collection; IRT analyses; CAT simulation. SETTING: Telephone and Internet survey. PARTICIPANTS: Two samples: SSA claimants (n=1017) and adults from the U.S. general population (n=999). INTERVENTIONS: None. MAIN OUTCOME MEASURES: Model fit statistics, correlation, and reliability coefficients. RESULTS: IRT analyses resulted in 5 unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. On comparing the simulated CATs with the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared with those of a sample of U.S. adults. CONCLUSIONS: The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties.

Development of an instrument to measure behavioral health function for work disability: item pool construction and factor analysis.

OBJECTIVES: To develop a broad set of claimant-reported items to assess behavioral health functioning relevant to the Social Security disability determination processes, and to evaluate the underlying structure of behavioral health functioning for use in development of a new functional assessment instrument. DESIGN: Cross-sectional. SETTING: Community. PARTICIPANTS: Item pools of behavioral health functioning were developed, refined, and field tested in a sample of persons applying for Social Security disability benefits (N=1015) who reported difficulties working because of mental or both mental and physical conditions. INTERVENTIONS: None. MAIN OUTCOME MEASURE: Social Security Administration Behavioral Health (SSA-BH) measurement instrument. RESULTS: Confirmatory factor analysis (CFA) specified that a 4-factor model (self-efficacy, mood and emotions, behavioral control, social interactions) had the optimal fit with the data and was also consistent with our hypothesized conceptual framework for characterizing behavioral health functioning. When the items within each of the 4 scales were tested in CFA, the fit statistics indicated adequate support for characterizing behavioral health as a unidimensional construct along these 4 distinct scales of function. CONCLUSIONS: This work represents a significant advance both conceptually and psychometrically in assessment methodologies for work-related behavioral health. The measurement of behavioral health functioning relevant to the context of work requires the assessment of multiple dimensions of behavioral health functioning. Specifically, we identified a 4-factor model solution that represented key domains of work-related behavioral health functioning. These results guided the development and scale formation of a new SSA-BH instrument.

Conceptual foundation for measures of physical function and behavioral health function for Social Security work disability evaluation.

Physical and mental impairments represent the 2 largest health condition categories for which workers receive Social Security disability benefits. Comprehensive assessment of physical and mental impairments should include aspects beyond medical conditions such as a person's underlying capabilities as well as activity demands relevant to the context of work. The objective of this article is to describe the initial conceptual stages of developing new measurement instruments of behavioral health and physical functioning relevant for Social Security work disability evaluation purposes. To outline a clear conceptualization of the constructs to be measured, 2 content models were developed using structured and informal qualitative approaches. We performed a structured literature review focusing on work disability and incorporating aspects of the International Classification of Functioning, Disability and Health as a unifying taxonomy for framework development. Expert interviews provided advice and consultation to enhance face validity of the resulting content models. The content model for work-related behavioral health function identifies 5 major domains: (1) behavior control, (2) basic interactions, (3) temperament and personality, (4) adaptability, and (5) workplace behaviors. The content model describing physical functioning includes 3 domains: (1) changing and maintaining body position, (2) whole-body mobility, and (3) carrying, moving, and handling objects. These content models informed subsequent measurement properties including item development and measurement scale construction, and provided conceptual coherence guiding future empirical inquiry. The proposed measurement approaches show promise to comprehensively and systematically assess physical and behavioral health functioning relevant to work.

Development of a self-report physical function instrument for disability assessment: item pool construction and factor analysis.

OBJECTIVES: To build a comprehensive item pool representing work-relevant physical functioning and to test the factor structure of the item pool. These developmental steps represent initial outcomes of a broader project to develop instruments for the assessment of function within the context of Social Security Administration (SSA) disability programs. DESIGN: Comprehensive literature review; gap analysis; item generation with expert panel input; stakeholder interviews; cognitive interviews; cross-sectional survey administration; and exploratory and confirmatory factor analyses to assess item pool structure. SETTING: In-person and semistructured interviews and Internet and telephone surveys. PARTICIPANTS: Sample of SSA claimants (n=1017) and a normative sample of adults from the U.S. general population (n=999). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURE: Model fit statistics. RESULTS: The final item pool consisted of 139 items. Within the claimant sample, 58.7% were white; 31.8% were black; 46.6% were women; and the mean age was 49.7 years. Initial factor analyses revealed a 4-factor solution, which included more items and allowed separate characterization of: (1) changing and maintaining body position, (2) whole body mobility, (3) upper body function, and (4) upper extremity fine motor. The final 4-factor model included 91 items. Confirmatory factor analyses for the 4-factor models for the claimant and the normative samples demonstrated very good fit. Fit statistics for claimant and normative samples, respectively, were: Comparative Fit Index=.93 and .98; Tucker-Lewis Index=.92 and .98; and root mean square error approximation=.05 and .04. CONCLUSIONS: The factor structure of the physical function item pool closely resembled the hypothesized content model. The 4 scales relevant to work activities offer promise for providing reliable information about claimant physical functioning relevant to work disability.

Scale refinement and initial evaluation of a behavioral health function measurement tool for work disability evaluation.

OBJECTIVE: To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. DESIGN: Cross-sectional survey followed by IRT calibration data simulations. SETTING: Community. PARTICIPANTS: Sample of individuals applying for Social Security Administration disability benefits: claimants (n=1015) and a normative comparative sample of U.S. adults (n=1000). INTERVENTIONS: None. MAIN OUTCOME MEASURE: SSA-BH measurement instrument. RESULTS: IRT analyses supported the unidimensionality of 4 SSA-BH scales: mood and emotions (35 items), self-efficacy (23 items), social interactions (6 items), and behavioral control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10-item computer adaptive tests with the full item bank indicated robust ability of the computer adaptive testing approach to comprehensively characterize behavioral health function along 4 distinct dimensions. CONCLUSIONS: Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all 4 scales. Behavioral function profiles of Social Security Administration claimants were generated and compared with age- and sex-matched norms along 4 scales: mood and emotions, behavioral control, social interactions, and self-efficacy. Using the computer adaptive test-based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the Social Security Administration's work disability programs.

Development of the computer-adaptive version of the Late-Life Function and Disability Instrument.

BACKGROUND: Having psychometrically strong disability measures that minimize response burden is important in assessing of older adults. METHODS: Using the original 48 items from the Late-Life Function and Disability Instrument and newly developed items, a 158-item Activity Limitation and a 62-item Participation Restriction item pool were developed. The item pools were administered to a convenience sample of 520 community-dwelling adults 60 years or older. Confirmatory factor analysis and item response theory were employed to identify content structure, calibrate items, and build the computer-adaptive testings (CATs). We evaluated real-data simulations of 10-item CAT subscales. We collected data from 102 older adults to validate the 10-item CATs against the Veteran's Short Form-36 and assessed test-retest reliability in a subsample of 57 subjects. RESULTS: Confirmatory factor analysis revealed a bifactor structure, and multi-dimensional item response theory was used to calibrate an overall Activity Limitation Scale (141 items) and an overall Participation Restriction Scale (55 items). Fit statistics were acceptable (Activity Limitation: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.03; Participation Restriction: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.05). Correlation of 10-item CATs with full item banks were substantial (Activity Limitation: r = .90; Participation Restriction: r = .95). Test-retest reliability estimates were high (Activity Limitation: r = .85; Participation Restriction r = .80). Strength and pattern of correlations with Veteran's Short Form-36 subscales were as hypothesized. Each CAT, on average, took 3.56 minutes to administer. CONCLUSIONS: The Late-Life Function and Disability Instrument CATs demonstrated strong reliability, validity, accuracy, and precision. The Late-Life Function and Disability Instrument CAT can achieve psychometrically sound disability assessment in older persons while reducing respondent burden. Further research is needed to assess their ability to measure change in older adults.