The Lower Extremity Physical Function Patient-Reported Outcome Measure Was Reliable, Valid, and Efficient for Patients With Musculoskeletal Impairments.

OBJECTIVE: To calibrate the Lower Extremity Functional Scale (LEFS) items into a regional lower extremity physical function (LEPF) item bank and assess reliability, validity, and efficiency of computerized adaptive test (CAT) and short form (SF) administration modes. DESIGN: Retrospective cohort. SETTING: Data were collected from patients treated in outpatient rehabilitation clinics for musculoskeletal impairments of the hip, knee, foot, and ankle that responded to all 20 LEFS items at intake. PARTICIPANTS: Patients aged 14 years or older who started an episode of care during January 2016-October 2019 and identified the lower extremity region as the source of a primary musculoskeletal complaint. Total cohort included 78,186 patients (mean age, 53±19y, range, 14-89y). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Item response theory (IRT) model assumptions of unidimensionality, local item independence, item fit, and presence of differential item functioning (DIF) were studied. LEPF-CAT- and LEPF-SF-generated scores were evaluated. RESULTS: An 18-item solution was supported for its unidimensionality and fit to the IRT model, with reliability estimates >0.9 for all administration modes. No DIF impact on LEPF scores was identified. Scores discriminated between multiple patient groups in clinically logical ways and were highly responsive to change, with negligible floor or ceiling effects. CAT scores were generated using an average of 4.9 items (median, 4). CONCLUSIONS: The LEPF scores were reliable, valid, and efficient for assessing perceived physical function of patients with musculoskeletal impairments of the hip, knee, foot, and ankle; thus, it was found suitable for research and routine clinical administration. These findings are limited to the type of patients included in this study, with further validation needed to assess their generalizability.

Associations between interim patient-reported outcome measures and functional status at discharge from rehabilitation for non-specific lumbar impairments.

PURPOSE: Identify impact of frequency and timing of interim Patient-Reported Outcome Measures (PROMs) assessments during episodes of care for rehabilitation services in outpatient clinical settings on functional status (FS) outcomes at discharge for patients with low back pain. METHODS: FS outcomes of patients who had no interim PROMs were compared to outcomes of six patient groups defined by interim timing (early, mid, late) and frequency (1, 2 or more). For each comparison, patients were matched using propensity score matching for variables known to be associated with FS outcomes and for episode duration (days) and number of visits. FS was assessed using the lumbar computerized adaptive test (LCAT) where scores range from 0 to 100 with higher scores representing better physical function. RESULTS: A sample of 140,336 patients was considered for matching (mean age = 58 [SD = 17] range 18-89; 60% females) with 83,101 patients (59%) having no interim PROMs. Patients who had only one interim PROM, administered during early (first 2 weeks), mid (weeks 3-4), or late (week 5 or later) timing, had 4.6, 2.7, and 1.0 additional FS score points at discharge compared to those without an interim PROM, respectively (p < 0.001). Having two or more interim PROMs was associated with an additional 1.2 FS points compared to having only one interim assessment, but only if the first interim was administered early. CONCLUSIONS: Optimal utilization of interim PROM assessment during clinical practice to enhance treatment outcomes was related to administering the first interim PROM within the first 2 weeks after the initial evaluation.

Reliability, Validity, and Efficiency of an Item Response Theory-Based Balance Confidence Patient-Reported Outcome Measure.

OBJECTIVE: The aims of this study were to calibrate the original 16 items from the Activities-Specific Balance Confidence (ABC) Scale to create an item response theory (IRT)-based item bank and scoring metric of balance confidence (BC) and to assess psychometric properties of a computerized adaptive test (BC-CAT) and 6-item short-form (BC-SF) administration modes. METHODS: This retrospective study included data from patients who were treated in outpatient rehabilitation clinics and assessed for balance impairments by responding to the full ABC Scale at intake. IRT model assumptions of unidimensionality, local item independence, item fit, and presence of differential item functioning (DIF) were evaluated. BC-CAT-generated scores were assessed for reliability, validity, and administration efficiency, and the newly developed BC-SF was assessed for reliability. RESULTS: Total cohort included 20,354 patients (mean age [SD] = 66 [16] years; range = 14-89). All 16 items were retained in the final item bank based on support for unidimensionality and fit to the IRT model. No items demonstrated DIF. Reliability estimates were 0.95, 0.96, and 0.98 for the BC-SF, BC-CAT, and the full item bank, respectively. Scores discriminated among patient groups in clinically logical ways. After controlling for scores at intake, better outcomes were achieved for patients who were younger, had more acute symptoms, exercised more, and had fewer comorbidities. Scores were responsive to change with a moderate effect size, with negligible floor and ceiling effects. CAT scores were generated using an average of 4.7 items (median = 4) and correlated highly with full-bank scores (Pearson correlation coefficient = 0.99). CONCLUSION: The IRT-based BC patient-reported outcome measure (PROM) was reliable, valid, moderately responsive to change, and efficient, with excellent score coverage. The measure is suitable for research and routine clinical administration using the BC-CAT or BC-SF administration modes. The full ABC Scale can be administered for increased clinical content when appropriate. IMPACT: The newly developed BC-PROM was reliable and valid for assessing perceived BC. In addition, the BC-PROM has efficient administration modes with low patient response burden, which enhances feasibility and promotes use during routine clinical practice in busy rehabilitation settings. This study supports a transition to PROMs that are based on modern measurement approaches to achieve the combined benefits of high accuracy and efficiency.

The Stroke Upper and Lower Extremity Physical Function Measures Were Supported for Score Reliability, Validity, and Administration Efficiency for Patients Poststroke.

OBJECTIVE: The aims of this study were to (1) evaluate the suitability of newly developed items for calibration into 2 item banks for stroke upper extremity (SUE) and stroke lower extremity (SLE) physical function (PF) patient-reported outcome measures (PROMs) and to (2) assess score reliability and validity and PROM administration efficiency based on computerized adaptive testing (CAT). METHODS: A retrospective longitudinal study involving patients poststroke who were treated in outpatient rehabilitation clinics and responded to 28 and 25 region-specific candidate items addressing tasks related to upper or lower extremity PF, respectively, was conducted. Item response theory (IRT) model assumptions of unidimensionality, local independence, item fit, and presence of differential item functioning were evaluated. CAT-generated scores were assessed for reliability, validity, and administration efficiency, and 10-item short forms were assessed for reliability. RESULTS: Cohorts consisted of 2017 patients with stroke involving the upper extremity and 2107 patients with stroke involving the lower extremity (mean age [SD]: SUE = 62 [14] and SLE = 63 [14]; range = 14-89). Two solutions (SUE: 28-item; SLE: 24-item) supported unidimensionality and fit to the IRT model, with reliability estimates >0.93 for all administration modes. No items demonstrated differential item functioning. Scores discriminated among multiple patient groups in clinically logical ways, with better outcomes observed for patients who were younger, were male, had less chronicity, and had fewer comorbidities. The SUE and SLE, respectively, had 1 and 0.3% floor effects and 4.3 and 1.1% ceiling effects. Change score effect sizes were 0.5 (SUE) and 0.6 (SLE). Simulated CAT scores required an average of 6 (SUE) and 5.6 (SLE) items (median = 5). CONCLUSION: The stroke upper extremity and stroke lower extremity PROM scores were reliable, valid, and efficient and had moderate change effect sizes for assessing PF as perceived by patients poststroke with upper and lower extremity impairments. Scores had negligible floor and acceptable ceiling effects. Based on these results, the stroke PROMs are suitable for research and routine clinical practice. IMPACT: As IRT-based measures, these PROMs support clinical practice guideline recommendations for the use of outcome measures in neurologic physical therapy and the administration of condition-specific functional questions with low response burden for patients. The 10-item short forms offer a feasible alternative administration mode when CAT administration is not available.

Lower Quadrant Edema Patient-Reported Outcome Measure Is Reliable, Valid, and Efficient for Patients With Lymphatic and Venous Disorders.

OBJECTIVE: The main aims of this study were: (1) to create a patient-reported outcome measure (PROM) item bank for measuring the impact of lower quadrant edema (LQE) on physical function using item response theory and (2) to assess reliability, validity, and administration efficiency of LQE PROM scores based on computerized adaptive test (CAT) and the reliability of a 10-item short form (SF). METHODS: This retrospective study included data from patients treated in outpatient rehabilitation clinics for lower quadrant edema who responded to all 30 candidate items at intake. Item response theory model assumptions of unidimensionality, local item independence, item fit, and presence of differential item functioning (DIF) were evaluated. LQE-CAT-generated scores were assessed for reliability, validity, and administration efficiency. LQE-SF-generated scores were assessed for reliability. RESULTS: The total cohort included 4894 patients (mean [SD] age = 65 [14] years; range = 14-89 years). A set of 20 items was selected for the item bank based on support for its unidimensionality and fit to the item response theory model, with reliability estimates greater than 0.92 for CAT and SF administration modes. No items demonstrated DIF with respect to tested variables. After controlling for scores at intake, scores discriminated among multiple patient groups in clinically logical ways with better outcomes observed for patients who were younger with less chronic symptoms and fewer comorbidities. Scores were responsive to change but the effect size was small (0.4). There were negligible floor and ceiling effects. CAT administration of the item bank required an average of 6.1 items (median = 5). Scores correlated highly with full-bank scores (Pearson correlation coefficient = 0.98). CONCLUSION: Scores on the LQE PROM were reliable, valid, and efficient for assessing perceived physical function of patients with lower quadrant edema. The LQE, CAT, and SF are suitable for research and routine clinical care. Reasons for the small effect size for change scores should be studied. IMPACT: The newly developed LQE PROM was reliable and valid and offered efficient administration modes for assessing perceived physical function of patients with LQE, both for research and routine clinical care in busy outpatient rehabilitation settings. As an item response theory-based measure, the LQE PROM allows administration of condition-specific functional questions with low response burden for patients. The 10-item LQE-SF offers a feasible alternative administration mode when CAT administration is not available. This study supports a transition to PROMs that are based on modern measurement approaches to achieve the combined benefits of high accuracy and efficiency.

Is Telerehabilitation a Viable Option for People With Low Back Pain? Associations Between Telerehabilitation and Outcomes During the COVID-19 Pandemic.

OBJECTIVE: The aims of this study were to examine associations between frequency of telerehabilitation (TR) and outcomes of functional status (FS), number of visits, and patient satisfaction during COVID-19 and to compare FS outcomes by TR delivery mode for individuals with low back pain. METHODS: Propensity score matching was used to match episodes of care with or without TR exposure by the probability of receiving TR. FS, visits, and satisfaction were compared for individuals without TR and those who received care by TR for "any," "few," "most," or "all" frequencies (4 matched samples), and FS was compared for individuals receiving synchronous, asynchronous, and mixed TR modes (3 matched samples). Standardized differences were used to compare samples before and after matching. Outcomes between matched samples were compared using z tests with 95% CI. RESULTS: The sample consisted of 91,117 episodes of care from 1398 clinics located in 46 states (58% women; mean age = 55 [SD = 18]). Of those, only 5013 episodes (5.5%) involved any amount of TR. All standardized differences between matched samples were <0.1. There was no significant difference in FS points (range = 0-100, with higher representing better FS) between matched samples, except for episodes that had ``few'' (-1.7) and ``all'' (+2.0) TR frequencies or that involved the asynchronous (-2.6) TR mode. These point differences suggest limited clinical importance. Episodes with any TR frequency involved significantly fewer visits (0.7-1.3) than episodes with no TR, except that those with the "most" TR frequency had non-significantly fewer visits (0.6). A smaller proportion of individuals with TR (-4.0% to -5.0%) than of individuals with no telerehabilitation reported being very satisfied with treatment results, except for those with the "all" TR frequency. CONCLUSIONS: A positive association between TR and rehabilitation outcomes was observed, with a trend for better FS outcomes and fewer visits when all care was delivered through TR. Satisfaction tended to be lower with TR use. Overall, this observational study showed that for people with low back pain, physical therapy delivered through TR was equally effective as and more efficient than in-person care, with a trend of higher effectiveness when used for all visits during the episode of care. No differences in FS outcomes were observed between care delivered with synchronous and mixed TR delivery modes and care delivered with no TR. However, the asynchronous mode of TR was associated with worse functional outcomes than no TR. Although the majority of people were very satisfied with their treatment results with and without TR, very high satisfaction rates were reported by a slightly smaller proportion of individuals with TR versus those without TR. Our results suggest that TR is a viable option for rehabilitation care for individuals with low back pain and should also be considered in the post-COVID-19 era.

Telerehabilitation During the COVID-19 Pandemic in Outpatient Rehabilitation Settings: A Descriptive Study.

OBJECTIVE: COVID-19 has widely affected delivery of health care. In response, telerehabilitation (TR) has emerged as alternative care model. Aims were: (1) to describe baseline patient characteristics and available unadjusted outcomes for episodes of care administered during COVID-19 using TR versus traditional in-person care, and (2) to describe TR frequency levels by condition and telecommunication modes. METHODS: A descriptive retrospective observational design was used to report patient variables and outcomes including physical function, number of visits, and patient satisfaction, by TR frequency (few, most, or all visits) and telecommunication modes. Standardized differences were used to compare baseline characteristics between episodes with and without TR. RESULTS: Sample consisted of 222,680 patients (59% female; mean [SD] age = 55 [18] years). Overall TR rate was 6% decreasing from 10% to 5% between second and third quarters of 2020. Outcome measures were available for 90% to 100% of episodes. Thirty-seven percent of clinicians administered care via TR. Patients treated using TR compared with in-person care were more likely to be younger and live in large metropolitan areas. From those with TR, 55%, 20%, and 25% had TR during few, most, or all visits, respectively. TR care was administered equally across orthopedic body parts, with lower use for nonorthopedic conditions such as stroke, edema, and vestibular dysfunction. TR was primarily administered using synchronous (video or audio) modes. The rate of patients reported being very satisfied with their treatment results was 3% higher for no TR compared with TR. CONCLUSIONS: These results provide new knowledge about to whom and how TR is being administered during the pandemic in outpatient rehabilitation practices throughout the United States. The database assessed was found to be suitable for conducting studies on associations between TR and diverse outcome measures, controlling for a comprehensive set of patient characteristics, to advance best TR care models, and promote high-quality care. IMPACT: This study provided detailed and robust descriptive information using an existing national patient database containing patient health and demographic characteristics, outcome measures, and telerehabilitation (TR) administration data. Findings support the feasibility to conduct future studies on associations between TR care and patient outcomes, adjusting for a wide range of patient characteristics and clinical setting factors that may be associated with the probability of receiving TR. The finding of limited and decreasing use of TR over the study period calls for studies aimed to better understand facilitators and inhibitors of TR use by rehabilitation therapists during everyday practice to promote its use when clinically appropriate.

Upper Quadrant Edema Patient-Reported Outcome Measure Is Reliable, Valid, and Efficient for Patients With Lymphatic and Venous Disorders.

OBJECTIVE: The main aims of this study were to (1) create a patient-reported outcome measure (PROM) item bank for measuring the impact of upper quadrant edema (UQE) on physical function by calibrating responses to newly developed items; and (2) assess reliability, validity, and administration efficiency of scores based on computerized adaptive test (CAT) and 10-item short-form (SF) administration modes. METHODS: This was a retrospective study including data from patients treated in outpatient rehabilitation clinics for UQE that responded to all 27 candidate items at intake. Item response theory model assumptions of unidimensionality, local item independence, item fit, and presence of differential item functioning were evaluated. UQE-CAT- and UQE-SF-generated scores were assessed for reliability, validity, and administration efficiency. RESULTS: The total cohort included 3486 patients (mean [SD] age = 61 [13] years; range = 14-89 years). After removing 2 items, a 25-item solution was supported for its unidimensionality and fit to the item response theory model with reliability estimates of more than 0.93 for scores based on both CAT and SF administration modes. No items demonstrated differential item functioning. Scores discriminated among multiple patient groups in clinically logical ways and were moderately responsive to change with negligible floor and acceptable ceiling effects. CAT scores were generated using an average of 5.6 items (median = 5). CONCLUSION: Scores on the UQE PROM were reliable, valid, and efficient for assessing perceived physical function of patients with upper quadrant edema; thus, the measure is suitable for research and routine clinical administration. IMPACT: The newly developed UQE PROM is reliable and valid and offers efficient administration modes for assessing perceived physical function of patients with UQE caused by lymphatic and venous disorders, both for research and routine clinical care in busy outpatient rehabilitation settings. As an item response theory-based measure, the UQE PROM allows administration of condition-specific functional questions with low response burden for patients. This study supports a transition to PROMs that are based on modern measurement approaches to achieve high accuracy and efficiency.

Clinical interpretation of computerized adaptive test-generated outcome measures in patients with knee impairments.

OBJECTIVE: To describe meaningful interpretations of functional status (FS) outcomes measures estimated using a body-part specific computerized adaptive test (CAT). DESIGN: A prospective observational cohort study. SETTING: Outpatient physical therapy clinics (291 clinics) in 30 U.S. states. PARTICIPANTS: Sample of 21,896 patients with knee impairments receiving outpatient physical therapy. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURE: FS estimated using CAT administration. RESULTS: We investigated 4 approaches to clinically meaningful interpretations of outcomes data: (1) 95% confidence interval for each score estimate, (2) percentile rank of FS scores, (3) responsiveness, and (4) functional staging. Overall, precision of a single score was estimated by FS score +/-5. Based on score distribution, percentile ranks at 25th, 50th, and 75th percentiles corresponded to intake FS scores of 33, 42, and 51 and discharge FS scores of 51, 61, and 74, respectively. Results showed that 9 or higher FS change units represented statistically and clinically important improvement. Patients were classified into 6 hierarchical levels of FS using functional staging. CONCLUSIONS: Results suggest how CAT-generated outcomes measures can be interpreted to assist clinicians and patients during rehabilitation.

Clinical interpretation of computerized adaptive test outcome measures in patients with foot/ankle impairments.

STUDY DESIGN: Prospective cohort study of 10 287 patients with foot/ankle impairments receiving outpatient physical therapy. OBJECTIVES: To describe meaningful interpretations of functional status (FS) outcomes measures, estimated using a body-part-specific computerized adaptive test (CAT). BACKGROUND: Increased use of CATs to generate outcome measures in rehabilitation has stimulated questions concerning score interpretation. Identifying meaningful intra-individual change and reporting clinical interpretation of those generated outcomes are essential to advance the quality of rehabilitation practice. METHODS: We performed 4 approaches to clinically interpret outcomes data. First, we used the standard error of the estimate to construct a 90% confidence interval for each CAT estimated score. Second, we presented the percentile rank of FS scores. Third, we used 2 threshold approaches to define individual-patient-level change: statistically reliable change and clinically important change. Last, we illustrated a functional staging method. RESULTS: Precision of a single score was estimated by an FS score of +/-4. Based on score distribution, percentile ranks at 25th, 50th, and 75th percentiles corresponded to intake FS scores of 38, 47, and 57, and discharge FS scores of 52, 64, and 77, respectively. Minimal detectable change supported 7 or more FS change units out of 100 represented statistically reliable change, and ROC analyses supported 8 or more FS change units represented minimal clinically important improvement. Using a functional staging system, we established 5 hierarchical functional status levels. CONCLUSION: CAT-generated outcome measures can be interpreted to improve clinical interpretation and to assist clinicians in using patient-reported outcomes during therapy practice.

Clinical Interpretation of the Neck Functional Status Computerized Adaptive Test.

BACKGROUND: Clinical interpretation of patient-reported outcome measures is an essential step in patient-centered care. Interpretation of scores derived from the Neck Functional Status Computerized Adaptive Test (NFS-CAT) has not been studied. OBJECTIVES: To (1) assess the reliability of point estimates and improvement scores, (2) determine thresholds of minimal clinically important improvement (MCII), and (3) develop a functional staging model to facilitate clinical interpretation of NFS-CAT scores. METHODS: A secondary retrospective cohort analysis was performed using data from patients aged 14 to 89 years who started an episode of care for neck impairments during 2016-2017 and completed the NFS-CAT at admission. The reliability of point estimates and of improvement scores was derived from the NFS-CAT standard error of measurement. The MCII was estimated by combining distribution- and anchor-based approaches. A functional staging model was developed to describe clinical meaningfulness of the quantitative scores provided by the NFS-CAT. RESULTS: Of 250 741 patients who completed the NFS-CAT at admission (mean ± SD age, 54 ± 16 years; 65% female), 169±039 (67%) also completed the NFS-CAT at discharge. The standard error of measurement was stable across the measurement continuum, ranging from 3.7 to 3.9 NFS-CAT points. Minimal detectable improvement was 6.8 points at the 90% confidence level. The estimate of the MCII was 8.1 points, with more change points needed to achieve the MCII for patients with lower baseline scores. Large rates of functional staging change during treatment were observed, demonstrating responsiveness of the functional staging model. CONCLUSION: This study demonstrated how the NFS-CAT can be interpreted to better assist clinicians and patients with neck impairments during outpatient rehabilitation. LEVEL OF EVIDENCE: Therapy, level 2b. J Orthop Sports Phys Ther 2019;49(12):875-886. Epub 10 Jul 2019. doi:10.2519/jospt.2019.8862.

A computerized adaptive test for patients with hip impairments produced valid and responsive measures of function.

OBJECTIVES: To describe the use of a computerized adaptive test (CAT) in routine clinical practice and evaluate content coverage and construct validity, sensitivity to change, and responsiveness of hip CAT functional status (FS) measures. DESIGN: Longitudinal, prospective observational cohort study. SETTING: Two hundred fifty-seven outpatient rehabilitation clinics in 31 states (United States). PARTICIPANTS: Two samples were examined: intake and discharge rehabilitation FS data from patients (N=8714) treated for hip impairments between January 2005 and June 2007 and data from patients (N=444) used to develop the hip CAT were examined for comparison (2002-2004). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Hip functional status and global rating of change. RESULTS: The CAT used on average 7 items to produce precise estimates of FS that adequately covered the content range with negligible floor and slight ceiling effects. Test information functions and SEs supported FS measure precision. FS measures discriminated patients in clinically logical ways. Sixty-one percent of patients obtained discharge FS measures greater than or equal to minimal detectable change (95% confidence intervals). Change of 6 FS units (scale: 0-100) represented minimal clinically important improvement, which 64% of patients obtained. CONCLUSIONS: The hip CAT was efficient; produced valid, responsive measures of FS for patients receiving therapy for hip impairments; and functioned well in routine clinical application but would benefit from more difficult items.

Calibration and validation of an item bank for measuring general physical function of patients in medical rehabilitation settings.

OBJECTIVE: The objective of this study was to report the item response theory (IRT) calibration of an 18-item bank to measure general physical function (GPF) in a wide range of conditions and evaluate the validity of the derived scores. METHODS: All 18 items were administered to a large sample of patients (n=2337) who responded to the items in the context of their outpatient rehabilitation care. The responses, collected 1997- 2000, were modeled using the graded response model, an IRT model appropriate for items with two or more response options. Inter-item consistency was evaluated based on Cronbach's alpha and item to total correlations. Validity of scores was evaluated based on known-groups comparisons (age, number of health problems, symptom severity). The strength of a single, general factor was evaluated using a bi-factor model. Results were used to evaluate IRT assumption and as an indicator of construct validity. Local independence of item responses was also evaluated. RESULTS: Response data met the assumptions of unidimensionality and local independence. Explained common variance of a single general factor was 0.88 (omega hierarchical =0.86). Only two of the 153 pairs of item residuals were flagged for local dependence. Inter-item consistency was high (0.93) as were item to total correlations (mean =0.61). Substantial variation was found in both IRT location (difficulty) and discrimination parameters. All omnibus known-groups comparisons were statistically significant (p<0.001). CONCLUSION: Item responses fit the IRT unidimensionality assumptions and were internally consistent. The usefulness of GPF scores in discriminating among patients with different levels of physical function was confirmed. Future studies should evaluate the validity of GPF scores based on an adaptive administration of items.

Impact of Risk Adjustment on Provider Ranking for Patients With Low Back Pain Receiving Physical Therapy.

Background The impact of risk adjustment on clinic quality ranking for patients treated in physical therapy outpatient clinics is unknown. Objectives To compare clinic ranking, based on unadjusted versus risk-adjusted outcomes for patients with low back pain (LBP) who are treated in physical therapy outpatient clinics. Methods This retrospective cohort study involved a secondary analysis of data from adult patients with LBP treated in outpatient physical therapy clinics from 2014 to 2016. Patients with complete outcomes data at admission and discharge were included to develop the risk-adjustment model. Clinics with complete outcomes data for at least 50% of patients and at least 10 complete episodes of care per clinician per year were included for ranking assessment. The R2 shrinkage and predictive ratio were used to assess overfitting. Agreement between unadjusted and adjusted rankings was assessed with percentile ranking by deciles or 3 distinct quality ranks based on uncertainty assessment. Results The primary sample included 414 125 patients (mean ± SD age, 57 ± 17 years; 60% women) treated by 12 569 clinicians from 3048 clinics from all US states; 82% of patients from 2107 clinics were included in the ranking assessment. The R2 shrinkage was less than 1%, with a predictive ratio of 1. Risk adjustment impacted ranking for 70% or 31% of clinics, based on deciles or 3 distinct quality levels, respectively. Conclusion Important changes in ranking were found after adjusting for basic patient characteristics of those admitted to physical therapy for treatment of LBP. Risk-adjustment profiling is necessary to more accurately reflect quality of care when treating patients with LBP. Level of Evidence Therapy, level 2b. J Orthop Sports Phys Ther 2018;48(8):637-648. Epub 22 May 2018. doi:10.2519/jospt.2018.7981.

Simulated computerized adaptive test for patients with lumbar spine impairments was efficient and produced valid measures of function.

OBJECTIVE: To equate physical functioning (PF) items with Back Pain Functional Scale (BPFS) items, develop a computerized adaptive test (CAT) designed to assess lumbar spine functional status (LFS) in people with lumbar spine impairments, and compare discriminant validity of LFS measures (theta(IRT)) generated using all items analyzed with a rating scale Item Response Theory model (RSM) and measures generated using the simulated CAT (theta(CAT)). METHODS: We performed a secondary analysis of retrospective intake rehabilitation data. RESULTS: Unidimensionality and local independence of 25 BPFS and PF items were supported. Differential item functioning was negligible for levels of symptom acuity, gender, age, and surgical history. The RSM fit the data well. A lumbar spine specific CAT was developed that was 72% more efficient than using all 25 items to estimate LFS measures. theta(IRT) and theta(CAT) measures did not discriminate patients by symptom acuity, age, or gender, but discriminated patients by surgical history in similar clinically logical ways. theta(CAT) measures were as precise as theta(IRT) measures. CONCLUSION: A body part specific simulated CAT developed from an LFS item bank was efficient and produced precise measures of LFS without eroding discriminant validity.

Simulated computerized adaptive test for patients with shoulder impairments was efficient and produced valid measures of function.

BACKGROUND AND OBJECTIVE: To test unidimensionality and local independence of a set of shoulder functional status (SFS) items, develop a computerized adaptive test (CAT) of the items using a rating scale item response theory model (RSM), and compare discriminant validity of measures generated using all items (theta(IRT)) and measures generated using the simulated CAT (theta(CAT)). STUDY DESIGN AND SETTING: We performed a secondary analysis of data collected prospectively during rehabilitation of 400 patients with shoulder impairments who completed 60 SFS items. RESULTS: Factor analytic techniques supported that the 42 SFS items formed a unidimensional scale and were locally independent. Except for five items, which were deleted, the RSM fit the data well. The remaining 37 SFS items were used to generate the CAT. On average, 6 items were needed to estimate precise measures of function using the SFS CAT, compared with all 37 SFS items. The theta(IRT) and theta(CAT) measures were highly correlated (r = .96) and resulted in similar classifications of patients. CONCLUSION: The simulated SFS CAT was efficient and produced precise, clinically relevant measures of functional status with good discriminating ability.

Simulated computerized adaptive tests for measuring functional status were efficient with good discriminant validity in patients with hip, knee, or foot/ankle impairments.

BACKGROUND AND OBJECTIVE: To develop computerized adaptive tests (CATs) designed to assess lower extremity functional status (FS) in people with lower extremity impairments using items from the Lower Extremity Functional Scale and compare discriminant validity of FS measures generated using all items analyzed with a rating scale Item Response Theory model (theta(IRT)) and measures generated using the simulated CATs (theta(CAT)). METHODS: Secondary analysis of retrospective intake rehabilitation data. RESULTS: Unidimensionality of items was strong, and local independence of items was adequate. Differential item functioning (DIF) affected item calibration related to body part, that is, hip, knee, or foot/ankle, but DIF did not affect item calibration for symptom acuity, gender, age, or surgical history. Therefore, patients were separated into three body part specific groups. The rating scale model fit all three data sets well. Three body part specific CATs were developed: each was 70% more efficient than using all LEFS items to estimate FS measures. theta(IRT) and theta(CAT) measures discriminated patients by symptom acuity, age, and surgical history in similar ways. theta(CAT) measures were as precise as theta(IRT) measures. CONCLUSION: Body part-specific simulated CATs were efficient and produced precise measures of FS with good discriminant validity.

The Development and Psychometric Properties of the Patient Self-Report Neck Functional Status Questionnaire (NFSQ).

STUDY DESIGN: Retrospective analysis of cross-sectional data. OBJECTIVE: To describe the development of a new self-report Neck Functional Status Questionnaire (NFSQ) and to assess its psychometric properties and practical application. The NFSQ was designed to assess functional status in patients with cervical (spine) disorders who seek outpatient therapy. BACKGROUND: Many patients seek outpatient therapy due to cervical disorders. Currently, no patient-reported outcome measures exist that capture the ability to perform functional activity in a manner that reflects the experience of this patient population. METHODS: Four hundred thirty-nine patients who were being treated for cervical disorders responded to a set of survey questions to assess activity-related functional outcomes associated with cervical disorders. Using item response theory, we assessed candidate items for unidimensionality and local independence, item fit, person separation, precision, targeting, and differential item functioning. We also compared discriminant validity of functional status measures estimated by the item response theory model (NFSQ fixed) and measures generated using a simulated computerized adaptive test (NFSQ computerized adaptive test). RESULTS: Based on expert opinion and subsequent processing and analyses, a final set of 28 items was used to develop the NFSQ. Unidimensionality and local independence were supported. The mean ± SD sample ability level of 57.6 ± 14.3 (scale range, 0-100) matched well with the mean item difficulty of the NFSQ of 51.3 ± 7.4. Differential item functioning was negligible for levels of age group, sex, and symptom acuity. The NFSQ computerized adaptive test measures were as precise as the NFSQ fixed measures. CONCLUSION: Study results supported the preliminary validity of the 28-item NFSQ for use in assessing patients with different levels of functional status related to their cervical disorders in outpatient rehabilitation settings.

The self-report fecal incontinence and constipation questionnaire in patients with pelvic-floor dysfunction seeking outpatient rehabilitation.

BACKGROUND: Fecal incontinence and constipation affect men and women of all ages. OBJECTIVE: The purpose of this study was to psychometrically analyze the Fecal Incontinence and Constipation Questionnaire (FICQ) in patients seeking outpatient rehabilitation services due to pelvic-floor dysfunction (PFD). DESIGN: This was a retrospective analysis of cross-sectional data from 644 patients (mean age=52 years, SD=16, range=18-91) being treated for PFD in 64 outpatient rehabilitation clinics in 20 states (United States). METHODS: We assessed the 20-item FICQ for unidimensionality and local independence, differential item functioning (DIF), item fit, item hierarchical structure, and test precision using an item response theory model. RESULTS: Factor analyses supported the 2-factor subscales as originally defined; items related to severity of leakage or constipation. Removal of 2 leakage items improved unidimensionality and local independence of the leakage scale. Among the remaining items, 2 items were suggestive of adjustment for DIF by age group and by number of PFD comorbid conditions. Item difficulties were suitable for patients with PFD with no ceiling or floor effect. Mean item difficulty parameters for leakage and constipation subscales ranged from 38.8 to 62.3 and 28.1 to 63.3 (0-100 scale), respectively. Endorsed leakage items representing highest difficulty levels were related to delay defecation and confidence to control bowel leakage. Endorsed constipation items representing highest difficulty levels were related to the need to strain during a bowel movement and the frequency of bowel movements. LIMITATIONS: A limitation of this study was the lack of medical diagnostic criteria to classify patients. CONCLUSIONS: After removing 2 items and adjusting for DIF, the results supported sound psychometric properties of the FICQ items and its initial use for patients with PFD in outpatient rehabilitation services.

Psychometric properties and practicability of the self-report urinary incontinence questionnaire in patients with pelvic-floor dysfunction seeking outpatient rehabilitation.

BACKGROUND: Pelvic-floor dysfunction (PFD) affects a substantial proportion of individuals, mostly women. In responding to the demands in measuring PFD outcomes in outpatient rehabilitation, the Urinary Incontinence Questionnaire (UIQ) was developed by FOTO in collaboration with an experienced physical therapist who has a specialty in treating patients with PFD. OBJECTIVE: The purpose of this study was to evaluate psychometric properties and practicability of the 21-item UIQ in patients seeking outpatient physical therapy services due to PFD. DESIGN: This was a retrospective analysis of cross-sectional data from 1,628 patients (mean age=53 years, SD=16, range=18-91) being treated for their PFD in 91 outpatient physical therapy clinics in 24 states (United States). METHODS: Using a 2-parameter logistic item response theory (IRT) procedure and the graded response model, the UIQ was assessed for unidimensionality and local independence, differential item functioning (DIF), discriminating ability, item hierarchical structure, and test precision. RESULTS: Four items were dropped to improve unidimensionality and discriminating ability. Remaining UIQ items met IRT assumptions of unidimensionality and local independence. One item was adjusted for DIF by age group. Item difficulties were suitable for patients with PFD with no ceiling or floor effect. Item difficulty parameters ranged from -2.20 to 0.39 logits. Endorsed items representing highest difficulty levels were related to control urine flow, impact of leaking urine on life, and confidence to control the urine leakage problem. Item discrimination parameters ranged from 0.48 to 1.18. Items with higher discriminating abilities were those related to impact on life of leaking urine, confidence to control the urine leakage problem, and the number of protective garments for urine leakage. LIMITATIONS: Because this study was a secondary analysis of prospectively collected data, missing data might have influenced our results. CONCLUSIONS: Preliminary analyses supported sound psychometric properties of the UIQ items and their initial use for patients with PFD in outpatient physical therapy services.