Scoping Review of Judgment-Based Measures of Ambulation with Assistive Devices for Children and Youth.

AIM: To identify available judgment-based measures of ambulation with assistive devices for the purpose of examining item content and responses to aid in the expansion of the Pediatric Evaluation of Disability Inventory Computer Adaptive Test (PEDI-CAT) Mobility Domain. METHODS: PubMed and CINAHL databases were used to identify measures meeting the following criteria: 1) applicable for children/youth; 2) self-report, proxy-report, or interview administration; and 3) assistive device (walker, cane, crutches, gait trainer) use specified or considered with responses. Population, administration, respondent(s), items, and responses were compiled. Item content was categorized and response scales grouped by type. RESULTS: Fifteen measures met inclusion criteria. Measures included child and proxy-report. Item categories included Surfaces, Steps/Stairs, Dual Tasks, Negotiation of Environment, Distance, and Time. Only two measures distinguished between device type within items. One measure specified gait trainers. "Difficulty" and "Assistance" were the most frequently used response scales. CONCLUSIONS: Available measures have content examining device use; however, none of the measures are comprehensive, devices are not consistently specified, and responses are imprecise. Items with well-defined responses for measuring a child's ambulation with an assistive device are needed for clinical practice, research, and program evaluation.

Item bank development for a revised pediatric evaluation of disability inventory (PEDI).

The Pediatric Evaluation of Disability Inventory (PEDI) is a useful clinical and research assessment, but it has limitations in content, age range, and efficiency. The purpose of this article is to describe the development of the item bank for a new computer adaptive testing version of the PEDI (PEDI-CAT). An expanded item set and response options were reviewed by clinician experts and examined at parent and clinician focus groups. Eleven parents participated in 32 cognitive interviews to examine content, format, and comprehension of items and responses. A set of 76 self-care, 78 mobility, and 64 social function items with pictures and a four-point "Difficulty" scale were developed. The PEDI's Caregiver Assistance scale was replaced by a "Responsibility Scale" with 53 items. Content validity was established incorporating input from clinicians and parents. The new item bank covers a broad range of functional activities for children of all ages and abilities.

Lessons from use of the Pediatric Evaluation of Disability Inventory: where do we go from here?

PURPOSE: The purpose of this article is to review the innovations, applications, and effect of the original Pediatric Evaluation of Disability Inventory (PEDI) published in 1992 and to describe planned revisions. SUMMARY OF KEY POINTS: During the past decade, the PEDI has helped to shift thinking from a developmental to a functional focus. Using the PEDI, researchers and clinicians worldwide have highlighted variations in functional skill acquisition in clinical populations, the importance of recognizing cultural differences, and the value of documenting functional progress in relation to interventions. CONCLUSIONS: The PEDI has had a rich tradition in helping to document functional development. New methods are proposed for the next generation of the PEDI by using item banks and computer adaptive testing. RECOMMENDATIONS FOR CLINICAL PRACTICE: The computer adaptive testing feature and the revised and expanded content of the new PEDI will enable therapists to more efficiently assess children's functioning to a broader age group of children.

Translation and cross-cultural adaptation of the PEDI-CAT: Dutch version.

PURPOSE: The PEDI-CAT measures daily functioning of children and youth, aged 1 to 21 years, with a variety of physical, cognitive and/or behavioral disabilities. In order to use an instrument in another culture or language, translation and cross-cultural validation are important, particularly for end-users. This study describes the process of translation and cross-cultural adaptation of the Dutch version of the PEDI-CAT. METHODS: End-users were involved in all steps. First, the PEDI-CAT items were reviewed to determine whether the items were relevant and acceptable in the Dutch culture. Then, the PEDI-CAT was translated into Dutch using specific guidelines. Finally, the wording of the Dutch items and response options were reviewed and tested with 22 parents of children and adolescents with and without disabilities. RESULTS: All 267 items and response options of the original PEDI-CAT were assessed as relevant and translated into Dutch. A selection of 175 items was tested with Think Aloud interviews which revealed that the translation of 46 items could be improved. CONCLUSION: The role of end-users in the process of translation and cross-cultural adaptation was crucial. This collaborative process resulted in a Dutch version of the PEDI-CAT that has been optimally adapted to the Dutch language and culture.

Creating a computer adaptive test version of the late-life function and disability instrument.

BACKGROUND: This study applied item response theory (IRT) and computer adaptive testing (CAT) methodologies to develop a prototype function and disability assessment instrument for use in aging research. Herein, we report on the development of the CAT version of the Late-Life Function and Disability Instrument (Late-Life FDI) and evaluate its psychometric properties. METHODS: We used confirmatory factor analysis, IRT methods, validation, and computer simulation analyses of data collected from 671 older adults residing in residential care facilities. We compared accuracy, precision, and sensitivity to change of scores from CAT versions of two Late-Life FDI scales with scores from the fixed-form instrument. Score estimates from the prototype CAT versus the original instrument were compared in a sample of 40 older adults. RESULTS: Distinct function and disability domains were identified within the Late-Life FDI item bank and used to construct two prototype CAT scales. Using retrospective data, scores from computer simulations of the prototype CAT scales were highly correlated with scores from the original instrument. The results of computer simulation, accuracy, precision, and sensitivity to change of the CATs closely approximated those of the fixed-form scales, especially for the 10- or 15-item CAT versions. In the prospective study, each CAT was administered in <3 minutes and CAT scores were highly correlated with scores generated from the original instrument. CONCLUSIONS: CAT scores of the Late-Life FDI were highly comparable to those obtained from the full-length instrument with a small loss in accuracy, precision, and sensitivity to change.

Prospective evaluation of the AM-PAC-CAT in outpatient rehabilitation settings.

BACKGROUND AND PURPOSE: The purpose of this study was to prospectively evaluate the practical and psychometric adequacy of the Activity Measure for Post-Acute Care (AM-PAC) "item bank" and computerized adaptive testing (CAT) assessment platform (AM-PAC-CAT) when applied within orthopedic outpatient physical therapy settings. METHOD: This was a prospective study with a convenience sample of 1,815 patients with spine, lower-extremity, or upper-extremity impairments who received outpatient physical therapy in 1 of 20 outpatient clinics across 5 states. The authors conducted an evaluation of the number of items used and amount of time needed to complete the CAT assessment; evaluation of breadth of content coverage, item exposure rate, and test precision; as well as an assessment of the validity and sensitivity to change of the score estimates. RESULTS: Overall, the AM-PAC-CAT's Basic Mobility scale demonstrated excellent psychometric properties while the Daily Activity scale demonstrated less adequate psychometric properties when applied in this outpatient sample. The mean length of time to complete the Basic Mobility scale was 1.9 minutes, using, on average, 6.6 items per CAT session, and the mean length of time to complete the Daily Activity scale was 1.01 minutes, using on average, 6.8 items. BACKGROUND AND CONCLUSION: Overall, the findings are encouraging, yet they do reveal several areas where the AM-PAC-CAT scales can be improved to best suit the needs of patients who are receiving outpatient orthopedic physical therapy of the type included in this study.

Development of the computer-adaptive version of the Late-Life Function and Disability Instrument.

BACKGROUND: Having psychometrically strong disability measures that minimize response burden is important in assessing of older adults. METHODS: Using the original 48 items from the Late-Life Function and Disability Instrument and newly developed items, a 158-item Activity Limitation and a 62-item Participation Restriction item pool were developed. The item pools were administered to a convenience sample of 520 community-dwelling adults 60 years or older. Confirmatory factor analysis and item response theory were employed to identify content structure, calibrate items, and build the computer-adaptive testings (CATs). We evaluated real-data simulations of 10-item CAT subscales. We collected data from 102 older adults to validate the 10-item CATs against the Veteran's Short Form-36 and assessed test-retest reliability in a subsample of 57 subjects. RESULTS: Confirmatory factor analysis revealed a bifactor structure, and multi-dimensional item response theory was used to calibrate an overall Activity Limitation Scale (141 items) and an overall Participation Restriction Scale (55 items). Fit statistics were acceptable (Activity Limitation: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.03; Participation Restriction: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.05). Correlation of 10-item CATs with full item banks were substantial (Activity Limitation: r = .90; Participation Restriction: r = .95). Test-retest reliability estimates were high (Activity Limitation: r = .85; Participation Restriction r = .80). Strength and pattern of correlations with Veteran's Short Form-36 subscales were as hypothesized. Each CAT, on average, took 3.56 minutes to administer. CONCLUSIONS: The Late-Life Function and Disability Instrument CATs demonstrated strong reliability, validity, accuracy, and precision. The Late-Life Function and Disability Instrument CAT can achieve psychometrically sound disability assessment in older persons while reducing respondent burden. Further research is needed to assess their ability to measure change in older adults.

Computer adaptive test performance in children with and without disabilities: prospective field study of the PEDI-CAT.

PURPOSE: To examine the discriminant validity, test-retest reliability, administration time and acceptability of the pediatric evaluation of disability inventory computer adaptive test (PEDI-CAT). METHODS: A sample of 102 parents of children 3 through 20 years of age with (n = 50) and without (n = 52) disabilities was recruited for this prospective field study. A sub-sample (n = 25) also completed the PEDI-CAT a second time within one month. Parents completed 15 items in each of the four PEDI-CAT domains (daily activities, mobility, social/cognitive, responsibility) using a laptop computer. Following completion, parents answered a four-question user evaluation survey. RESULTS: PEDI-CAT scores based on parent responses differentiated between groups of children with and without disabilities in all four domains. Test-retest reliability estimates were high (ICC = 0.96-0.99) for all four domains. The mean time to complete 60 items for the full sample (n = 102) was 12.66 minutes (SD = 4.47). Parents reported favorable reactions to the PEDI-CAT. CONCLUSIONS: The PEDI-CAT offers a valid and reliable assessment acceptable to parents.

Replenishing a computerized adaptive test of patient-reported daily activity functioning.

PURPOSE: Computerized adaptive testing (CAT) item banks may need to be updated, but before new items can be added, they must be linked to the previous CAT. The purpose of this study was to evaluate 41 pretest items prior to including them into an operational CAT. METHODS: We recruited 6,882 patients with spine, lower extremity, upper extremity, and nonorthopedic impairments who received outpatient rehabilitation in one of 147 clinics across 13 states of the USA. Forty-one new Daily Activity (DA) items were administered along with the Activity Measure for Post-Acute Care Daily Activity CAT (DA-CAT-1) in five separate waves. We compared the scoring consistency with the full item bank, test information function (TIF), person standard errors (SEs), and content range of the DA-CAT-1 to the new CAT (DA-CAT-2) with the pretest items by real data simulations. RESULTS: We retained 29 of the 41 pretest items. Scores from the DA-CAT-2 were more consistent (ICC = 0.90 versus 0.96) than DA-CAT-1 when compared with the full item bank. TIF and person SEs were improved for persons with higher levels of DA functioning, and ceiling effects were reduced from 16.1% to 6.1%. CONCLUSIONS: Item response theory and online calibration methods were valuable in improving the DA-CAT.

Adaptive short forms for outpatient rehabilitation outcome assessment.

OBJECTIVE: To develop outpatient Adaptive Short Forms for the Activity Measure for Post-Acute Care item bank for use in outpatient therapy settings. DESIGN: A convenience sample of 11,809 adults with spine, lower limb, upper limb, and miscellaneous orthopedic impairments who received outpatient rehabilitation in 1 of 127 outpatient rehabilitation clinics in the United States. We identified optimal items for use in developing outpatient Adaptive Short Forms based on the Basic Mobility and Daily Activities domains of the Activity Measure for Post-Acute Care item bank. Patient scores were derived from the Activity Measure for Post-Acute Care computerized adaptive testing program. Items were selected for inclusion on the Adaptive Short Forms based on functional content, range of item coverage, measurement precision, item exposure rate, and data collection burden. RESULTS: Two outpatient Adaptive Short Forms were developed: (1) an 18-item Basic Mobility Adaptive Short Form and (2) a 15-item Daily Activities Adaptive Short Form, derived from the same item bank used to develop the Activity Measure for Post-Acute Care computerized adaptive testing program. Both Adaptive Short Forms achieved acceptable psychometric properties. CONCLUSIONS: In outpatient postacute care settings where computerized adaptive testing outcome applications are currently not feasible, item response theory-derived Adaptive Short Forms provide the efficient capability to monitor patients' functional outcomes. The development of Adaptive Short Form functional outcome instruments linked by a common, calibrated item bank has the potential to create a bridge to outcome monitoring across postacute care settings and can facilitate the eventual transformation from Adaptive Short Forms to computerized adaptive testing applications easier and more acceptable to the rehabilitation community.