Strategies to address participant misrepresentation for eligibility in Web-based research.

Emerging methodological research suggests that the World Wide Web ("Web") is an appropriate venue for survey data collection, and a promising area for delivering behavioral intervention. However, the use of the Web for research raises concerns regarding sample validity, particularly when the Web is used for recruitment and enrollment. The purpose of this paper is to describe the challenges experienced in two different Web-based studies in which participant misrepresentation threatened sample validity: a survey study and an online intervention study. The lessons learned from these experiences generated three types of strategies researchers can use to reduce the likelihood of participant misrepresentation for eligibility in Web-based research. Examples of procedural/design strategies, technical/software strategies and data analytic strategies are provided along with the methodological strengths and limitations of specific strategies. The discussion includes a series of considerations to guide researchers in the selection of strategies that may be most appropriate given the aims, resources and target population of their studies.

Accuracy and precision of the Pediatric Evaluation of Disability Inventory computer-adaptive tests (PEDI-CAT).

AIM: The aims of the study were to: (1) build new item banks for a revised version of the Pediatric Evaluation of Disability Inventory (PEDI) with four content domains: daily activities, mobility, social/cognitive, and responsibility; and (2) use post-hoc simulations based on the combined normative and disability calibration samples to assess the accuracy and precision of the PEDI computer-adaptive tests (PEDI-CAT) compared with the administration of all items. METHOD: Parents of typically developing children (n = 2205) and parents of children and adolescents with disabilities (n = 703) between the ages of 0 and 21 years, stratified by age and sex, participated by responding to PEDI-CAT surveys through an existing Internet opt-in survey panel in the USA and by computer tablets in clinical sites. RESULTS: Confirmatory factor analyses supported four unidimensional content domains. Scores using the real data post hoc demonstrated excellent accuracy (intraclass correlation coefficients ≥ 0.95) with the full item banks. Simulations using item parameter estimates demonstrated relatively small bias in the 10-item and 15-item CAT versions; error was generally higher at the scale extremes. INTERPRETATION: These results suggest the PEDI-CAT can be an accurate and precise assessment of children's daily performance at all functional levels.