Unsupervised item response theory models for assessing sample heterogeneity in patient-reported outcomes measures.

PURPOSE: Unsupervised item-response theory (IRT) models such as polytomous IRT based on recursive partitioning (IRTrees) and mixture IRT (MixIRT) models can be used to assess differential item functioning (DIF) in patient-reported outcome measures (PROMs) when the covariates associated with DIF are unknown a priori. This study examines the consistency of results for IRTrees and MixIRT models. METHODS: Data were from 4478 individuals in the Alberta Provincial Project on Outcome Assessment in Coronary Heart Disease registry who received cardiac angiography in Alberta, Canada, and completed the Hospital Anxiety and Depression Scale (HADS) depression subscale items. The partial credit model (PCM) based on recursive partitioning (PCTree) and mixture PCM (MixPCM) were used to identify covariates associated with differential response patterns to HADS depression subscale items. Model covariates included demographic and clinical characteristics. RESULTS: The median (interquartile range) age was 64.5(15.7) years, and 3522(78.5%) patients were male. The PCTree identified 4 terminal nodes (subgroups) defined by smoking status, age, and body mass index. A 3-class PCM fits the data well. The MixPCM latent classes were defined by age, disease indication, smoking status, comorbid diabetes, congestive heart failure, and chronic obstructive pulmonary disease. CONCLUSION: PCTree and MixPCM were not consistent in detecting covariates associated with differential interpretations of PROM items. Future research will use computer simulations to assess these models' Type I error and statistical power for identifying covariates associated with DIF.

Transitions between versions of the International Classification of Diseases and chronic disease prevalence estimates from administrative health data: a population-based study.

BACKGROUND: Diagnosis codes in administrative health data are routinely used to monitor trends in disease prevalence and incidence. The International Classification of Diseases (ICD), which is used to record these diagnoses, have been updated multiple times to reflect advances in health and medical research. Our objective was to examine the impact of transitions between ICD versions on the prevalence of chronic health conditions estimated from administrative health data. METHODS: Study data (i.e., physician billing claims, hospital records) were from the province of Manitoba, Canada, which has a universal healthcare system. ICDA-8 (with adaptations), ICD-9-CM (clinical modification), and ICD-10-CA (Canadian adaptation; hospital records only) codes are captured in the data. Annual study cohorts included all individuals 18 + years of age for 45 years from 1974 to 2018. Negative binomial regression was used to estimate annual age- and sex-adjusted prevalence and model parameters (i.e., slopes and intercepts) for 16 chronic health conditions. Statistical control charts were used to assess the impact of changes in ICD version on model parameter estimates. Hotelling's T2 statistic was used to combine the parameter estimates and provide an out-of-control signal when its value was above a pre-specified control limit. RESULTS: The annual cohort sizes ranged from 360,341 to 824,816. Hypertension and skin cancer were among the most and least diagnosed health conditions, respectively; their prevalence per 1,000 population increased from 40.5 to 223.6 and from 0.3 to 2.1, respectively, within the study period. The average annual rate of change in prevalence ranged from -1.6% (95% confidence interval [CI]: -1.8, -1.4) for acute myocardial infarction to 14.6% (95% CI: 13.9, 15.2) for hypertension. The control chart indicated out-of-control observations when transitioning from ICDA-8 to ICD-9-CM for 75% of the investigated chronic health conditions but no out-of-control observations when transitioning from ICD-9-CM to ICD-10-CA. CONCLUSIONS: The prevalence of most of the investigated chronic health conditions changed significantly in the transition from ICDA-8 to ICD-9-CM. These results point to the importance of considering changes in ICD coding as a factor that may influence the interpretation of trend estimates for chronic health conditions derived from administrative health data.