Combining multiple imputation and bootstrap in the analysis of cost-effectiveness trial data.

In healthcare cost-effectiveness analysis, probability distributions are typically skewed and missing data are frequent. Bootstrap and multiple imputation are well-established resampling methods for handling skewed and missing data. However, it is not clear how these techniques should be combined. This paper addresses combining multiple imputation and bootstrap to obtain confidence intervals of the mean difference in outcome for two independent treatment groups. We assessed statistical validity and efficiency of 10 candidate methods and applied these methods to a clinical data set. Single imputation nested in the bootstrap percentile method (with added noise to reflect the uncertainty of the imputation) emerged as the method with the best statistical properties. However, this method can require extensive computation times and the lack of standard software makes this method not accessible for a larger group of researchers. Using a standard unpaired t-test with standard multiple imputation without bootstrap appears to be a robust alternative with acceptable statistical performance for which standard multiple imputation software is available.

Missing data in a multi-item instrument were best handled by multiple imputation at the item score level.

OBJECTIVES: Regardless of the proportion of missing values, complete-case analysis is most frequently applied, although advanced techniques such as multiple imputation (MI) are available. The objective of this study was to explore the performance of simple and more advanced methods for handling missing data in cases when some, many, or all item scores are missing in a multi-item instrument. STUDY DESIGN AND SETTING: Real-life missing data situations were simulated in a multi-item variable used as a covariate in a linear regression model. Various missing data mechanisms were simulated with an increasing percentage of missing data. Subsequently, several techniques to handle missing data were applied to decide on the most optimal technique for each scenario. Fitted regression coefficients were compared using the bias and coverage as performance parameters. RESULTS: Mean imputation caused biased estimates in every missing data scenario when data are missing for more than 10% of the subjects. Furthermore, when a large percentage of subjects had missing items (>25%), MI methods applied to the items outperformed methods applied to the total score. CONCLUSION: We recommend applying MI to the item scores to get the most accurate regression model estimates. Moreover, we advise not to use any form of mean imputation to handle missing data.

A standardized microarray assay for the independent gene expression markers in AML: EVI1 and BAALC.

High levels of BAALC, ERG, EVI1 and MN1 expression have been associated with shorter overall survival in AML but standardized and clinically validated assays are lacking. We have therefore developed and optimized an assay for standardized detection of these prognostic genes for patients with intermediate cytogenetic risk AML. In a training set of 147 intermediate cytogenetic risk cases we performed cross validations at 5 percentile steps of expression level and observed a bimodal significance profile for BAALC expression level and unimodal significance profiles for ERG and MN1 levels with no statistically significant cutoff points near the median expression level of BAALC, ERG or MN1. Of the possible cutoff points for expression levels of BAALC, ERG and MN1, just the 30th and 75th percentile of BAALC expression level and the 30th percentile of MN1 expression level cutoff points showed clinical significance. Of these only the 30th percentile of BAALC expression level reproduced in an independent verification (extended training) data set of 242 cytogenetically normal AML cases and successfully validated in an external cohort of 215 intermediate cytogenetic risk AML cases. Finally, we show independent prognostic value for high EVI1 and low BAALC in multivariate analysis with other clinically relevant molecular AML markers. We have developed a highly standardized molecular assay for the independent gene expression markers EVI1 and BAALC.

Detection of CEBPA double mutants in acute myeloid leukemia using a custom gene expression array.

Double (bi-allelic) mutations in the gene encoding the CCAAT/enhancer-binding protein-alpha (CEBPA) transcription factor have a favorable prognostic impact in acute myeloid leukemia (AML). Double mutations in CEBPA can be detected using various techniques, but it is a notoriously difficult gene to sequence due to its high GC-content. Here we developed a two-step gene expression classifier for accurate and standardized detection of CEBPA double mutations. The key feature of the two-step classifier is that it explicitly removes cases with low CEBPA expression, thereby excluding CEBPA hypermethylated cases that have similar gene expression profiles as a CEBPA double mutant, which would result in false-positive predictions. In the second step, we have developed a 55 gene signature to identity the true CEBPA double-mutation cases. This two-step classifier was tested on a cohort of 505 unselected AML cases, including 26 CEBPA double mutants, 12 CEBPA single mutants, and seven CEBPA promoter hypermethylated cases, on which its performance was estimated by a double-loop cross-validation protocol. The two-step classifier achieves a sensitivity of 96.2% (95% confidence interval [CI] 81.1 to 99.3) and specificity of 100.0% (95% CI 99.2 to 100.0). There are no false-positive detections. This two-step CEBPA double-mutation classifier has been incorporated on a microarray platform that can simultaneously detect other relevant molecular biomarkers, which allows for a standardized comprehensive diagnostic assay. In conclusion, gene expression profiling provides a reliable method for CEBPA double-mutation detection in patients with AML for clinical use.

Transcriptional profiles associated with aging and middle age-onset caloric restriction in mouse hearts.

To provide a global analysis of gene expression in the aging heart, we monitored the expression of 9,977 genes simultaneously in 5- and 30-month-old male B6C3F(1) mice by using high-density oligonucleotide microarrays and several statistical techniques. Aging was associated with transcriptional alterations consistent with a metabolic shift from fatty acid to carbohydrate metabolism, increased expression of extracellular matrix genes, and reduced protein synthesis. Caloric restriction (CR) started at 14 months of age resulted in a 19% global inhibition of age-related changes in gene expression. Interestingly, CR also resulted in alterations in gene expression consistent with preserved fatty acid metabolism, reduced endogenous DNA damage, decreased innate immune activity, apoptosis modulation, and a marked cytoskeletal reorganization. These observations provide evidence that aging of the heart is associated with specific transcriptional alterations, and that CR initiated in middle age may retard heart aging by inducing a profound transcriptional reprogramming.