Learning from microarray interlaboratory studies: measures of precision for gene expression.

BACKGROUND: The ability to demonstrate the reproducibility of gene expression microarray results is a critical consideration for the use of microarray technology in clinical applications. While studies have asserted that microarray data can be "highly reproducible" under given conditions, there is little ability to quantitatively compare amongst the various metrics and terminology used to characterize and express measurement performance. Use of standardized conceptual tools can greatly facilitate communication among the user, developer, and regulator stakeholders of the microarray community. While shaped by less highly multiplexed systems, measurement science (metrology) is devoted to establishing a coherent and internationally recognized vocabulary and quantitative practice for the characterization of measurement processes. RESULTS: The two independent aspects of the metrological concept of "accuracy" are "trueness" (closeness of a measurement to an accepted reference value) and "precision" (the closeness of measurement results to each other). A carefully designed collaborative study enables estimation of a variety of gene expression measurement precision metrics: repeatability, several flavors of intermediate precision, and reproducibility. The three 2004 Expression Analysis Pilot Proficiency Test collaborative studies, each with 13 to 16 participants, provide triplicate microarray measurements on each of two reference RNA pools. Using and modestly extending the consensus ISO 5725 documentary standard, we evaluate the metrological precision figures of merit for individual microarray signal measurement, building from calculations appropriate to single measurement processes, such as technical replicate expression values for individual probes on a microarray, to the estimation and display of precision functions representing all of the probes in a given platform. CONCLUSION: With only modest extensions, the established metrological framework can be fruitfully used to characterize the measurement performance of microarray and other highly multiplexed systems. Precision functions, summarizing routine precision metrics estimated from appropriately repeated measurements of one or more reference materials as functions of signal level, are demonstrated and merit further development for characterizing measurement platforms, monitoring changes in measurement system performance, and comparing performance among laboratories or analysts.

The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements.

Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.

National prevalence and exposure risk for cockroach allergen in U.S. households.

UNLABELLED: We characterized the prevalence of cockroach allergen exposure in a nationally representative sample of U.S. homes and assessed risk factors for elevated concentrations. DESIGN: We used data from the National Survey of Lead and Allergens in Housing, a population-based cross-sectional survey. PARTICIPANTS: Participants were residents of 831 U.S. homes in the survey. EVALUATIONS/MEASUREMENTS: We analyzed allergen, questionnaire, and observational data of 831 U.S. homes. RESULTS: Cockroach allergen (Bla g 1) concentrations exceed 2.0 U/g, a level associated with allergic sensitization, in 11% of U.S. living room floors and 13% of kitchen floors. Concentrations exceed 8.0 U/g, a level associated with asthma morbidity, in 3% of living room floors and 10% of kitchen floors. Elevated concentrations were observed in high-rise apartments, urban settings, pre-1940 constructions, and households with incomes < $20,000. Odds of having concentrations > 8.0 U/g were greatest when roach problems were reported or observed and increased with the number of cockroaches observed and with indications of recent cockroach activity. CONCLUSIONS: Household cockroach allergen exposure is characterized in a nationally representative context. The allergen is prevalent in many settings, at levels that may contribute to allergic sensitization and asthma morbidity. RELEVANCE TO CLINICAL OR PROFESSIONAL PRACTICE: Likelihood of exposure can be assessed by consideration of demographic and household determinants.