Improving multimorbidity measurement using individualized disease-specific quality of life impact assessments: predictive validity of a new comorbidity index.

BACKGROUND: Interpretation of health-related quality of life (QOL) outcomes requires improved methods to control for the effects of multiple chronic conditions (MCC). This study systematically compared legacy and improved method effects of aggregating MCC on the accuracy of predictions of QOL outcomes. METHODS: Online surveys administered generic physical (PCS) and mental (MCS) QOL outcome measures, the Charlson Comorbidity Index (CCI), an expanded chronic condition checklist (CCC), and individualized QOL Disease-specific Impact Scale (QDIS) ratings in a developmental sample (N = 5490) of US adults. Controlling for sociodemographic variables, regression models compared 12- and 35-condition checklists, mortality vs. population QOL-weighting, and population vs. individualized QOL weighting methods. Analyses were cross-validated in an independent sample (N = 1220) representing the adult general population. Models compared estimates of variance explained (adjusted R2) and model fit (AIC) for generic PCS and MCS across aggregation methods at baseline and nine-month follow-up. RESULTS: In comparison with sociodemographic-only regression models (MCS R2 = 0.08, PCS = 0.09) and Charlson CCI models (MCS R2 = 0.12, PCS = 0.16), increased variance was accounted for using the 35-item CCC (MCS R2 = 0.22, PCS = 0.31), population MCS/PCS QOL weighting (R2 = 0.31-0.38, respectively) and individualized QDIS weighting (R2 = 0.33 & 0.42). Model R2 and fit were replicated upon cross-validation. CONCLUSIONS: Physical and mental outcomes were more accurately predicted using an expanded MCC checklist, population QOL rather than mortality CCI weighting, and individualized rather than population QOL weighting for each reported condition. The 3-min combination of CCC and QDIS ratings (QDIS-MCC) warrant further testing for purposes of predicting and interpreting QOL outcomes affected by MCC.

Developing a New Version of the SF-6D Health State Classification System From the SF-36v2: SF-6Dv2.

OBJECTIVE: The objective of this study was to develop the classification system for version of the SF-6D (SF-6Dv2) from the SF-36v2. SF-6Dv2 is an improved version of SF-6D, one of the most widely used generic measures of health for the calculation of quality-adjusted life years. STUDY DESIGN AND SETTING: A 3-step process was undertaken to generate a new classification system: (1) factor analysis to establish dimensionality; (2) Rasch analysis to understand item performance; and (3) tests of differential item function. To evaluate robustness, Rasch analyses were performed in multiple subsets of 2 large cross-sectional datasets from recently discharged hospital patients and online patient samples. RESULTS: On the basis of factor analysis, other psychometric evidence, cross-cultural considerations, and amenability to valuation, the 6-dimension classification used in SF-6D was maintained. SF-6Dv2 resulted in the following modifications to SF-6D: a simpler classification of physical function with clearer separation between levels; a more detailed 5-level description of role limitations; using negative wording to describe vitality; and using pain severity rather than pain interference. CONCLUSIONS: The SF-6Dv2 classification system describes more distinct levels of health than SF-6D, changes the descriptions used for a number of dimensions and provides clearer wording for health state valuation. The second stage of the study has developed a utility value set using discrete choice methods so that the measure can be used in health technology assessment. Further work should investigate the psychometric characteristics of the new instrument.

Improving CKD-Specific Patient-Reported Measures of Health-Related Quality of Life.

BACKGROUND: Patient-reported outcome measures that are more practical and clinically useful are needed for patients with CKD. We compared a new CKD-specific quality-of-life impact scale (CKD-QOL) with currently used measures. METHODS: Patients (n=485) in different treatment groups (nondialysis stages 3-5, on dialysis, or post-transplant) completed the kidney-specific CKD-QOL and Kidney Disease Quality of Life-36 (KDQOL-36) forms and the generic SF-12 Health Survey at baseline and 3 months. New items summarizing quality of life (QOL) impact attributed to CKD across six QOL domains yielded single impact scores from a six-item static (fixed-length) form and from computerized adaptive tests (CATs) with three to six items. Validity tests compared the CKD-QOL, KDQOL-36 (Burden, Effects, and Symptoms/Problems subscales), and generic SF-12 measures across groups in four tests of clinical status and clinician assessment of change (CKD-specific tests), and number of comorbidities. ANOVA was used to test for group mean differences, variances in each measure explained by groups, and relative validity (RV) in comparison with the referent KDQOL-36 Burden subscale. RESULTS: KDQOL-36 and CKD-QOL measures generally discriminated better than generic SF-12v2 measures. The pattern of variances across CKD-specific tests comparing validity favored CKD-QOL two-fold over KDQOL-36. Two RV test results confirmed CKD-QOL improvements over the referent KDQOL scale. Results for static and CAT CKD-QOL forms were similar. SF-12 Physical and KDQOL-36 Symptoms scores worsened with increasing comorbid condition counts. CONCLUSIONS: Overall, compared with the KDQOL-36, the new approach to summarizing CKD-specific QOL impact performed better across multiple tests of validity. CAT surveys were more efficient than static surveys.

Barriers to Healthcare Access and to Improvements in Health-Related Quality of Life After an Acute Coronary Syndrome (From TRACE-CORE).

Little is known about how barriers to healthcare access affect health-related quality of life (HRQOL) after an acute coronary syndrome (ACS). In a large cohort of ACS survivors from 6 medical centers in Massachusetts and Georgia enrolled from 2011 to 2013, patients were classified as having any financial barriers, no usual source of care (USOC), or transportation barriers to healthcare based on their questionnaire survey responses. The principal study outcomes included clinically meaningful declines in generic physical and mental HRQOL and in disease-specific HRQOL from 1 to 6 months posthospital discharge. Adjusted relative risks (aRRs) for declines in HRQOL were calculated using Poisson regression models, controlling for several sociodemographic and clinical factors of prognostic importance. In 1,053 ACS survivors, 29.0% had a financial barrier, 14.2% had no USOC, and 8.7% had a transportation barrier. Patients with a financial barrier had greater risks of experiencing a decline in generic physical (aRR 1.48, 95% confidence interval [CI] 1.17, 1.86) and mental (aRR 1.36, 95% CI 1.07, 1.75) HRQOL at 6 months. Patients with 2 or more access barriers had greater risks of decline in generic physical (aRR 1.53, 95% CI 1.20, 1.93) and mental (aRR 1.50, 95% CI 1.17, 1.93) HRQOL compared with those without any healthcare barriers. There was a modest association between lacking a USOC and experiencing a decline in disease-specific HRQOL (aRR 1.46, 95% CI 0.96, 2.22). Financial and other barriers to healthcare access may be associated with clinically meaningful declines in HRQOL after hospital discharge for an ACS.

Survivors of an Acute Coronary Syndrome With Lower Patient Activation Are More Likely to Experience Declines in Health-Related Quality of Life.

BACKGROUND: Patient activation comprises the knowledge, skills, and confidence for self-care and may lead to better health outcomes. OBJECTIVES: We examined the relationship between patient activation and changes in health-related quality of life (HRQOL) after hospitalization for an acute coronary syndrome (ACS). METHODS: We studied patients from 6 medical centers in central Massachusetts and Georgia who had been hospitalized for an ACS between 2011 and 2013. At 1 month after hospital discharge, the patients completed the 6-item Patient Activation Measure and were categorized into 4 levels of activation. Multinomial logistic regression analyses compared activation level with clinically meaningful changes (≥3.0 points, generic; ≥10.0 points, disease-specific) in generic physical (SF-36v2 Physical Component Summary [PCS]), generic mental (SF-36v2 Mental Component Summary [MCS]), and disease-specific (Seattle Angina Questionnaire [SAQ]) HRQOL from 1 to 3 and 1 to 6 months after hospitalization, adjusting for potential sociodemographic and clinical confounders. RESULTS: The patients (N = 1042) were, on average, 62 years old, 34% female, and 87% non-Hispanic white. A total of 10% were in the lowest level of activation. The patients with the lowest activation had 1.95 times (95% confidence interval, 1.05-3.62) and 2.18 times (95% confidence interval, 1.17-4.05) the odds of experiencing clinically significant declines in MCS and SAQ HRQOL, respectively, between 1 and 6 months than the most activated patients. The patient activation level was not associated with meaningful changes in PCS scores. CONCLUSIONS: Hospital survivors of an ACS with lower activation may be more likely to experience declines in mental and disease-specific HRQOL than more-activated patients, identifying a group at risk of poor outcomes.

Varying the item format improved the range of measurement in patient-reported outcome measures assessing physical function.

BACKGROUND: Physical function (PF) is a core patient-reported outcome domain in clinical trials in rheumatic diseases. Frequently used PF measures have ceiling effects, leading to large sample size requirements and low sensitivity to change. In most of these instruments, the response category that indicates the highest PF level is the statement that one is able to perform a given physical activity without any limitations or difficulty. This study investigates whether using an item format with an extended response scale, allowing respondents to state that the performance of an activity is easy or very easy, increases the range of precise measurement of self-reported PF. METHODS: Three five-item PF short forms were constructed from the Patient-Reported Outcomes Measurement Information System (PROMIS®) wave 1 data. All forms included the same physical activities but varied in item stem and response scale: format A ("Are you able to …"; "without any difficulty"/"unable to do"); format B ("Does your health now limit you …"; "not at all"/"cannot do"); format C ("How difficult is it for you to …"; "very easy"/"impossible"). Each short-form item was answered by 2217-2835 subjects. We evaluated unidimensionality and estimated a graded response model for the 15 short-form items and remaining 119 items of the PROMIS PF bank to compare item and test information for the short forms along the PF continuum. We then used simulated data for five groups with different PF levels to illustrate differences in scoring precision between the short forms using different item formats. RESULTS: Sufficient unidimensionality of all short-form items and the original PF item bank was supported. Compared to formats A and B, format C increased the range of reliable measurement by about 0.5 standard deviations on the positive side of the PF continuum of the sample, provided more item information, and was more useful in distinguishing known groups with above-average functioning. CONCLUSIONS: Using an item format with an extended response scale is an efficient option to increase the measurement range of self-reported physical function without changing the content of the measure or affecting the latent construct of the instrument.

Validity and Responsiveness of the Knee Injury and Osteoarthritis Outcome Score: A Comparative Study Among Total Knee Replacement Patients.

OBJECTIVE: To evaluate validity and responsiveness of the Knee Injury and Osteoarthritis Outcome Score (KOOS) in relation to other patient-reported outcome measures before and after total knee replacement (TKR). METHODS: Pre-TKR and 6-month post-TKR data from 1,143 patients in a US joint replacement cohort were used to compare the KOOS, Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), and the SF-36 Health Survey (SF-36). Validity was evaluated with multiple methods, including correlations of pre-TKR scale scores and analysis of variance models that used pre-TKR data to compare the relative validity of scales in discriminating between groups differing in assistive walking device use and number of comorbid conditions. Validity was also evaluated by using post-TKR minus pre-TKR change scores to assess relative validity of scales in discriminating between groups rating themselves as better, same, or worse (BSW) in their capability to do activities at 6 months. Responsiveness also was described using effect sizes and standardized response means. RESULTS: In support of convergent and discriminant validity, KOOS scale scores were worse for patients using an assistive device but only declined weakly with increasing comorbid conditions. While all knee-specific scales discriminated between BSW groups, the KOOS quality of life (QOL) scale was significantly better (P < 0.05) than all measures except the SF-36 physical component summary. KOOS QOL also had the highest effect size, while SF-36 measures had lower effect sizes and standardized response means. KOOS pain and symptoms scales discriminated better than WOMAC pain and stiffness scales among BSW groups. CONCLUSION: KOOS scales were valid and responsive in this cohort of US TKR patients. KOOS QOL performed particularly well in capturing aggregate knee-specific outcomes.

Standardizing disease-specific quality of life measures across multiple chronic conditions: development and initial evaluation of the QOL Disease Impact Scale (QDIS®).

BACKGROUND: To document the development and evaluation of the Quality of life Disease Impact Scale (QDIS®), a measure that standardizes item content and scoring across chronic conditions and provides a summary, norm-based QOL impact score for each disease. METHODS: A bank of 49 disease impact items was constructed from previously-used descriptions of health impact to represent ten frequently-measured quality of life (QOL) content areas and operational definitions successfully utilized in generic QOL surveys. In contrast to health in general, all items were administered with attribution to a specific disease (osteoarthritis, rheumatoid arthritis, angina, myocardial infarction, congestive heart failure, chronic kidney disease (CKD), diabetes, asthma, or COPD). Responses from 5418 adults were analyzed as five disease groups: arthritis, cardiovascular, CKD, diabetes, and respiratory. Unidimensionality, item parameter and scale-level invariance, reliability, validity and responsiveness to change during 9-month follow-up were evaluated by disease group and for all groups combined using multi-group confirmatory factor analysis (MGCFA), item response theory (IRT) and analysis of variance methods. QDIS was normed in an independent chronically ill US population sample (N = 4120). RESULTS: MGCFA confirmed a 1-factor model, justifying a summary score estimated using equal parameters for each item across disease groups. In support of standardized IRT-based scoring, correlations were very high between disease-specific and standardized IRT item slopes (r = 0.88-0.96), thresholds (r = 0.93-0.99) and person-level scores (r ≥ 0.99). Internal consistency, test-retest and person-level IRT reliability were consistently satisfactory across groups. In support of interpreting QDIS as a disease-specific measure, in comparison with generic measures, QDIS consistently discriminated markedly better across disease severity levels, correlated higher with other disease-specific measures in cross-sectional tests, and was more responsive in comparisons of groups with better, same or worse evaluations of disease-specific outcomes at the 9-month follow-up. CONCLUSIONS: Standardization of content and scoring across diseases was shown to be justified psychometrically and enabled the first summary measure of disease-specific QOL impact normed in the chronically ill population. This disease-specific approach substantially improves discriminant validity and responsiveness over generic measures and provides a basis for better understanding the relative QOL impact of multiple chronic conditions in research and clinical practice.

The Validity of Disease-specific Quality of Life Attributions Among Adults with Multiple Chronic Conditions.

BACKGROUND: A crucial assumption underlying all disease-specific quality of life (QOL) measures, that patients can validly differentiate a specific disease in the presence of multiple chronic conditions, has not been tested using multiple methods. Our objective was to evaluate the convergent and discriminant validity of QOL attributions to specific diseases among adults with multiple chronic conditions (MCC). METHODS: Adults age 18 and older (N=4,480) sampled from eight pre-identified condition groups (asthma, COPD, angina/MI with angina, congestive heart failure, diabetes, chronic kidney disease, osteoarthritis, rheumatoid arthritis) completed an Internet survey. Comorbid conditions were determined using a 35-condition checklist. Product-moment correlations were analyzed separately by pre-identified condition group using the multitrait-multimethod of construct validation, where traits were defined by 9-26 conditions and each condition was measured by two methods: disease severity rating and Disease-specific Quality of Life Impact Scale (QDIS) global rating. A third method (symptom or clinical marker) was available for the eight pre-identified conditions. Convergent validity was supported when correlations among different methods of measuring the same condition (trait) were substantial (r≥0.40). Discriminant validity was supported when correlations between the same and different methods of measuring different conditions were significantly lower than corresponding convergent correlations. RESULTS: In support of convergent validity, 22 of 24 convergent correlations were substantial (r=0.38-0.84, median=0.53). In support of discriminant validity, 833 of 924 tests (90.2%) yielded significantly higher convergent than discriminant correlations across the eight pre-identified conditions. Exceptions to this pattern of results were most often observed for comorbid conditions within the same clinical area. CONCLUSIONS: Collectively, convergent and discriminant test results support the construct validity of disease-specific QOL impact attributions across MCC within the eight pre-identified conditions. Noteworthy exceptions should be considered when interpreting some specific QOL impact attributions and warrant further study. Pursuit of a summary disease-specific QOL impact score standardized across MCC is recommended.

Evaluation of smoking-specific and generic quality of life measures in current and former smokers in Germany and the United States.

BACKGROUND: Health-related quality of life (QOL) surveys include generic measures that enable comparisons across conditions and measures that focus more specifically on one disease or condition. We evaluated the psychometric properties of German- and English-language versions of survey scales representing both types of measures in samples of current and former smokers. METHODS: TQOLIT(™)v1 integrates new measures of smoking-specific symptoms and QOL impact attributed to smoking with generic SF-36 Health Survey measures. For purposes of evaluation, cross-sectional data were analyzed for two independent samples. Disease-free (otherwise healthy) adults ages 23-55 used a tablet to complete surveys in a clinical trial in Germany (125 current and 54 former smokers). Online general population surveys were completed in the US by otherwise healthy current and former smokers (N = 149 and 110, respectively). Evaluations included psychometric tests of assumptions underlying scale construction and scoring, score distributions, and reliability. Tests of validity included cross-sectional correlations and analyses of variance based on a conceptual framework and hypotheses for groups differing in self-reported smoking behavior (current versus former smoker, cigarettes per day (CPD)) and severity of smoking symptoms in both samples and, in the German trial only, clinical parameters of biomarkers of exposure. RESULTS: Tests of scaling assumptions and internal consistency reliability (alpha = 0.71-0.79) of the smoking-specific measures were satisfactory, although ceiling effects attenuated correlations for former smokers in both samples. Correlational evidence supporting validity of smoking-specific symptom and impact measures included their substantial inter-correlation and higher correlations (than generic measures) with smoking behavior (favoring former over current groups) and CPD in both samples. In the German trial, both smoking-specific measures correlated significantly (p < 0.05) with all four biomarkers. QOL impact attributed to smoking correlated with the SF-36 mental but not physical summary measures in both samples. CONCLUSIONS: German- and English-language TQOLITv1 surveys have comparable and satisfactory psychometric properties. Cross-sectional tests, including correlations with four biomarkers, support the validity of the new smoking-specific measures for use in studies of otherwise healthy smokers. Smoking-specific measures consistently performed better than generic QOL measures in all tests of validity.

Preliminary Evaluation of a New German Translated Tobacco Quality of Life Impact Tool to Discriminate Between Healthy Current and Former Smokers and to Explore the Effect of Switching Smokers to a Reduced Toxicant Prototype Cigarette.

BACKGROUND: Assessment of health-related quality of life (HRQoL) is well established in clinical research, but ceiling effects in validated tools might prevent detection of changes in well respondents. Tobacco Quality of Life Impact Tool (TQOLITv1) uses conceptual and psychometric advances to enhance detection of HRQoL changes. METHODS: In a 6-month, forced-switch study, the German TQOLITv1 was assessed in healthy adult (age 23-55 years) current and matched former-smokers. At baseline, smokers were switched to reduced toxicant prototype (RTP) or conventional cigarette for 6 months. TQOLITv1 responses were collected at baseline, 3 and 6 months from current smokers whilst former smokers completed it at the latter two time points. TQOLITv1 includes SF-36v2 and new smoking-specific, physical and general-health measures. RESULTS: Reliability at baseline was good (Cronbach's coefficient alpha > 0.70) for all measures. The baseline percentage with the best possible score (ceiling effect) for former and current smokers was substantially better for the new physical function than SF-36 physical function measure (35% vs. 59% at ceiling, respectively). New smoking-specific measures discriminated current from former smokers better than general health measures. Smoking-specific symptoms (r = 0.73) were more stable from baseline to 6 months than other measures (r = 0.38-0.54) particularly more than the SF-36 mental component score (r = 0.24). Although both product smoking groups worsened in most HRQoL measures, changes in general and smoking-specific HRQoL impact measures favored RTP smokers. CONCLUSIONS: The German TQOLITv1 is sufficiently reliable and valid to assess HRQoL and may be more useful than SF-36v2 in evaluation of interventions in well smoking populations including those consuming RTPs.

Measurement properties of the Western Ontario and McMaster Universities Osteoarthritis Index: a systematic review.

OBJECTIVE: To conduct a systematic review of the measurement properties of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and to evaluate the quality of WOMAC measurement studies using COSMIN (Consensus-Based Standards for the Selection of Health Measurement Instruments) criteria. METHODS: A search was conducted in the MEDLINE, CINAHL, Embase, PsycINFO, Scopus, and SPORTDiscus databases through September 2013. Data that assessed the WOMAC measurement model, reliability, validity, respondent burden, and equivalence across methods of administration were extracted. Overall study quality was rated following COSMIN criteria. RESULTS: A total of 76 articles from 22 countries were included. Internal consistency reliability was consistently high (≥0.90) for the function scale and acceptable (≥0.70) for the pain and stiffness scales. Test-retest reliability was acceptable. Score equivalence was demonstrated across paper and electronic methods of data collection. Floor and ceiling effects were low except for notable (24-38%) proportions of patients achieving the best possible scores on the pain and stiffness scales 1-23 years after arthroplasty. Five exploratory factor analyses did not support a measurement model in which the pain and function items were distinct. Correlations between the WOMAC pain and function scales were high (median 0.79). The WOMAC pain and function scales had similar correlations with other pain measures, and therefore the WOMAC pain scale did not show divergent validity. COSMIN criteria were not fully met in most studies. CONCLUSION: The WOMAC scales were reliable, but its pain scale was highly related to physical function. Further research into joint-specific pain measures that have broader content validity is needed.

Confirmatory factor analysis of the thyroid-related quality of life questionnaire ThyPRO.

BACKGROUND AND AIM: Thyroid diseases are prevalent and chronic. With treatment, quality of life is restored in most, but not all patients. Construct validity of the thyroid-related quality of life questionnaire, ThyPRO, has been established by multi-trait scaling, but not evaluated with more elaborate methods. The purpose of the present study was to evaluate dimensionality of the ThyPRO scales and to attempt to understand possible item misfit through structural equation modeling for categorical data. METHODS: The current 85-item version of ThyPRO consists of 13 scales, covering domains of physical (4 scales) and mental (2 scales) symptoms, function and well-being (3 scales) and participation/social function (4 scales). The data were collected from a cross-sectional sample of 907 thyroid patients. One-factor confirmatory models were fitted to each scale, and evaluated by model fit statistics (comparative fit index >0.95, root mean square error of approximation <0.08), magnitude of factor loadings, model residual correlations and modification indices (MI). Indications of multi-dimensionality were tested in bi-factor models. Possible item misfit was evaluated in a combined, investigational model. RESULTS: Each ThyPRO scale was adequately represented by a unidimensional model after minor revisions. Eleven items were identified in the unidimensional models as potentially misfitting and were investigated further by multidimensional modeling. CONCLUSION: Elaborate psychometric modeling supported the construct validity of the ThyPRO. However, 11 potentially misfitting items and 18 items with local dependence to other items are candidates for removal in future item reduction processes.

The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency.

OBJECTIVE: To document the development and psychometric evaluation of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) item bank and static instruments. STUDY DESIGN AND SETTING: The items were evaluated using qualitative and quantitative methods. A total of 16,065 adults answered item subsets (n>2,200/item) on the Internet, with oversampling of the chronically ill. Classical test and item response theory methods were used to evaluate 149 PROMIS PF items plus 10 Short Form-36 and 20 Health Assessment Questionnaire-Disability Index items. A graded response model was used to estimate item parameters, which were normed to a mean of 50 (standard deviation [SD]=10) in a US general population sample. RESULTS: The final bank consists of 124 PROMIS items covering upper, central, and lower extremity functions and instrumental activities of daily living. In simulations, a 10-item computerized adaptive test (CAT) eliminated floor and decreased ceiling effects, achieving higher measurement precision than any comparable length static tool across four SDs of the measurement range. Improved psychometric properties were transferred to the CAT's superior ability to identify differences between age and disease groups. CONCLUSION: The item bank provides a common metric and can improve the measurement of PF by facilitating the standardization of patient-reported outcome measures and implementation of CATs for more efficient PF assessments over a larger range.

Normative Data for the Singapore English and Chinese SF-36 Version 2 Health Survey.

INTRODUCTION: The aim of this study is to report normative data for the Short-Form 36 version 2 (SF-36v2) for assessing health-related quality of life, in the Singapore general population. MATERIALS AND METHODS: Data for English and Chinese-speaking participants of the Singapore Prospective Study Programme were analysed. The SF-36v2 scores were norm-based with the English-speaking Singapore general population as reference and reported by age (in decades), gender and ethnicity as well as for the 5 most prevalent chronic medical conditions. Scores were reported separately for the English and Chinese language versions. RESULTS: A total of 6151 English-speaking (61.5% Chinese and 19.2% Malay) and 1194 Chinese-speaking participants provided complete data. Mean (SD) age of all participants was 49.6 (12.58) years with 52.4% being women. In both languages, women reported lower scores than men on all scales. Among the chronic medical conditions, stroke had the largest impact on all English SF-36v2 scales and on 3 Chinese SF-36v2 scales (role-physical, general health and social functioning). CONCLUSION: We have provided detailed normative data for the Singapore English and Chinese SF-36v2, which would be valuable in furthering HRQoL research in Singapore and possibly the region.

Method of administration of PROMIS scales did not significantly impact score level, reliability, or validity.

OBJECTIVES: To test the impact of the method of administration (MOA) on score level, reliability, and validity of scales developed in the Patient Reported Outcomes Measurement Information System (PROMIS). STUDY DESIGN AND SETTING: Two nonoverlapping parallel forms each containing eight items from each of three PROMIS item banks (Physical Function, Fatigue, and Depression) were completed by 923 adults with chronic obstructive pulmonary disease, depression, or rheumatoid arthritis. In a randomized crossover design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) and a second form by PC, in the same administration. Method equivalence was evaluated through analyses of difference scores, intraclass correlations (ICCs), and convergent/discriminant validity. RESULTS: In difference score analyses, no significant mode differences were found and all confidence intervals were within the prespecified minimal important difference of 0.2 standard deviation. Parallel-forms reliabilities were very high (ICC = 0.85-0.93). Only one across-mode ICC was significantly lower than the same-mode ICC. Tests of validity showed no differential effect by MOA. Participants preferred screen interface over PQ and IVR. CONCLUSION: We found no statistically or clinically significant differences in score levels or psychometric properties of IVR, PQ, or PDA administration compared with PC.

Difference in method of administration did not significantly impact item response: an IRT-based analysis from the Patient-Reported Outcomes Measurement Information System (PROMIS) initiative.

PURPOSE: To test the impact of method of administration (MOA) on the measurement characteristics of items developed in the Patient-Reported Outcomes Measurement Information System (PROMIS). METHODS: Two non-overlapping parallel 8-item forms from each of three PROMIS domains (physical function, fatigue, and depression) were completed by 923 adults (age 18-89) with chronic obstructive pulmonary disease, depression, or rheumatoid arthritis. In a randomized cross-over design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) on the Internet, and a second form by PC, in the same administration. Structural invariance, equivalence of item responses, and measurement precision were evaluated using confirmatory factor analysis and item response theory methods. RESULTS: Multigroup confirmatory factor analysis supported equivalence of factor structure across MOA. Analyses by item response theory found no differences in item location parameters and strongly supported the equivalence of scores across MOA. CONCLUSIONS: We found no statistically or clinically significant differences in score levels in IVR, PQ, or PDA administration as compared to PC. Availability of large item response theory-calibrated PROMIS item banks allowed for innovations in study design and analysis.

Development and evaluation of a crosswalk between the SF-36 physical functioning scale and Health Assessment Questionnaire disability index in rheumatoid arthritis.

BACKGROUND: The SF-36 physical functioning scale (PF-10) and the Health Assessment Questionnaire disability index (HAQ-DI) are the most frequently used instruments for measuring self-reported physical function in rheumatoid arthritis (RA). The objective of this study was to develop a crosswalk between scores on the PF-10 and HAQ-DI in RA. METHODS: Item response theory (IRT) methods were used to co-calibrate both scales using data from 1791 RA patients. The appropriateness of a Rasch-based crosswalk was evaluated by comparing it with crosswalks based on a two-parameter and a multi-dimensional IRT model. The accuracy of the final crosswalk was cross-validated using baseline (n = 532) and 6-month follow-up (n = 276) data from an independent cohort of early RA patients. RESULTS: The PF-10 and HAQ-DI adequately fit a unidimensional Rasch model. Both scales measured a wide range of functioning, although the HAQ-DI tended to better target lower levels of functioning. The Rasch-based crosswalk performed similarly to crosswalks based on the two-parameter and multidimensional IRT models. Agreement between predicted and observed scale scores in the cross-validation sample was acceptable for group-level comparisons. The longitudinal validity in discriminating between disease response states was similar between observed and predicted scores. CONCLUSION: The crosswalk developed in this study allows for converting scores from one scale to the other and can be used for group-level analyses in patients with RA.

Reliability and validity of the English (Singapore) and Chinese (Singapore) versions of the Short-Form 36 version 2 in a multi-ethnic urban Asian population in Singapore.

PURPOSE: We aimed to evaluate the measurement properties of the Singapore English and Chinese versions of the Short-Form 36 version 2 (SF-36v2) Questionnaire, an improved version of the widely used SF-36, for assessing health-related quality of life (HRQoL) in a multi-ethnic urban Asian population in Singapore. METHODS: SF-36v2 scores and data on medical history, demographic and lifestyle factors from the Singapore Prospective Study Programme were analyzed. Convergent and divergent validity, internal consistency, floor and ceiling effects, known group validity and factor structure of the SF-36v2 were assessed for the English and Chinese versions, respectively. RESULTS: Complete data for 4,917 participants (45.8 %) out of 10,747 eligible individuals were analyzed (survey language: 4,115 English and 802 Chinese). Item-scale correlations exceeded 0.4 for all items of the English SF-36v2 and for all except one item of the Chinese SF-36v2 (bathe and dress: item-scale correlation: 0.36). In the English SF-36v2, Cronbach's alpha exceeded 0.70 for all scales. In the Chinese SF-36v2, Cronbach's alpha exceeded 0.7 on all scales except social functioning (Cronbach's alpha: 0.68). For known groups validity, respondents with chronic medical conditions expectedly reported lower SF-36v2 score on most English and Chinese SF-36v2 scales. In confirmatory factor analysis, the Singapore three-component model was favored over the United States two-component and Japan three-component models. CONCLUSIONS: The English and Chinese SF-36v2 are valid and reliable for assessing HRQoL among English and Chinese-speaking Singaporeans. Test-retest reliability and responsiveness of the English and Chinese SF-36v2 in Singapore remain to be evaluated.

Computerized adaptive testing--ready for ambulatory monitoring?

BACKGROUND: Computerized adaptive tests (CATs) have abundant theoretical advantages over established static instruments, which could improve ambulatory monitoring of patient-reported outcomes (PROs). However, an empirical demonstration of their practical benefits is warranted. METHODS: We reviewed the literature and evaluated existing data to discuss the potential of CATs for use in ambulatory monitoring outside clinical facilities. RESULTS: Computerized adaptive tests are not being used for ambulatory monitoring, but initial results from their use in health care research allow for discussion of some issues relevant to ambulatory care. Evidence shows that CATs can capture the most relevant health outcomes as well as established static tools, with substantially decreased respondent burden. They can be more precise than static tools of similar length and can reduce floor and ceiling effects. Computerized adaptive tests can reliably measure a construct over time with different items, which yields the potential of introducing item exposure control in ambulatory monitoring. Studies have shown that CATs can be at least as valid as well-designed static tools in group comparisons, but further investigation is needed to determine whether psychometric advantages lead to increased responsiveness of CATs. CONCLUSIONS: Ambulatory monitoring of PROs demands short, yet very precise measurements, which can be repeated up to many times a day. Computerized adaptive tests may address several present shortcomings in ambulatory monitoring of PROs efficiently. However, most CAT developments have primarily focused on psychometric improvements. To use the full potential of CATs for ambulatory monitoring purposes, content must also be carefully considered.