Summarizing performance for genome scale measurement of miRNA: reference samples and metrics.

BACKGROUND: The potential utility of microRNA as biomarkers for early detection of cancer and other diseases is being investigated with genome-scale profiling of differentially expressed microRNA. Processes for measurement assurance are critical components of genome-scale measurements. Here, we evaluated the utility of a set of total RNA samples, designed with between-sample differences in the relative abundance of miRNAs, as process controls. RESULTS: Three pure total human RNA samples (brain, liver, and placenta) and two different mixtures of these components were evaluated as measurement assurance control samples on multiple measurement systems at multiple sites and over multiple rounds. In silico modeling of mixtures provided benchmark values for comparison with physical mixtures. Biomarker development laboratories using next-generation sequencing (NGS) or genome-scale hybridization assays participated in the study and returned data from the samples using their routine workflows. Multiplexed and single assay reverse-transcription PCR (RT-PCR) was used to confirm in silico predicted sample differences. Data visualizations and summary metrics for genome-scale miRNA profiling assessment were developed using this dataset, and a range of performance was observed. These metrics have been incorporated into an online data analysis pipeline and provide a convenient dashboard view of results from experiments following the described design. The website also serves as a repository for the accumulation of performance values providing new participants in the project an opportunity to learn what may be achievable with similar measurement processes. CONCLUSIONS: The set of reference samples used in this study provides benchmark values suitable for assessing genome-scale miRNA profiling processes. Incorporation of these metrics into an online resource allows laboratories to periodically evaluate their performance and assess any changes introduced into their measurement process.

Cell-based reference samples designed with specific differences in microRNA biomarkers.

BACKGROUND: We demonstrate the feasibility of creating a pair of reference samples to be used as surrogates for clinical samples measured in either a research or clinical laboratory setting. The reference sample paradigm presented and evaluated here is designed to assess the capability of a measurement process to detect true differences between two biological samples. Cell-based reference samples can be created with a biomarker signature pattern designed in silico. Clinical laboratories working in regulated applications are required to participate in proficiency testing programs; research laboratories doing discovery typically do not. These reference samples can be used in proficiency tests or as process controls that allow a laboratory to evaluate and optimize its measurement systems, monitor performance over time (process drift), assess changes in protocols, reagents, and/or personnel, maintain standard operating procedures, and most importantly, provide evidence for quality results. RESULTS: The biomarkers of interest in this study are microRNAs (miRNAs), small non-coding RNAs involved in the regulation of gene expression. Multiple lung cancer associated cell lines were determined by reverse transcription (RT)-PCR to have sufficiently different miRNA profiles to serve as components in mixture designs as reference samples. In silico models based on the component profiles were used to predict miRNA abundance ratios between two different cell line mixtures, providing target values for profiles obtained from in vitro mixtures. Two reference sample types were tested: total RNA mixed after extraction from cell lines, and intact cells mixed prior to RNA extraction. MicroRNA profiling of a pair of samples composed of extracted RNA derived from these cell lines successfully replicated the target values. Mixtures of intact cells from these lines also approximated the target values, demonstrating potential utility as mimics for clinical specimens. Both designs demonstrated their utility as reference samples for inter- or intra-laboratory testing. CONCLUSIONS: Cell-based reference samples can be created for performance assessment of a measurement process from biomolecule extraction through quantitation. Although this study focused on miRNA profiling with RT-PCR using cell lines associated with lung cancer, the paradigm demonstrated here should be extendable to genome-scale platforms and other biomolecular endpoints.

Two approaches for estimating the lower limit of quantitation (LLOQ) of microRNA levels assayed as exploratory biomarkers by RT-qPCR.

BACKGROUND: Circulating microRNAs are undergoing exploratory use as safety biomarkers in drug development. Reverse transcription quantitative polymerase chain reaction (RT-qPCR) is one common approach used to quantitate levels of microRNAs in samples that includes the use of a standard curve of calibrators fit to a regression model. Guidelines are needed for setting assay quantitation thresholds that are appropriate for this method and to biomarker pre-validation. RESULTS: In this report, we develop two workflows for determining a lower limit of quantitation (LLOQ) for RT-qPCR assays of microRNAs in exploratory studies. One workflow is based on an error threshold calculated by a logistic model of the calibration curve data. The second workflow is based on a threshold set by the sample blank, which is the no template control for RT-qPCR. The two workflows are used to set lower thresholds of reportable microRNA levels for an example dataset in which miR-208a levels in biofluids are quantitated in a cardiac injury model. LLOQ thresholds set by either workflow are effective in filtering out microRNA values with large uncertainty estimates. CONCLUSIONS: Two workflows for LLOQ determinations are presented in this report that provide methods that are easy to implement in investigational studies of microRNA safety biomarkers and offer choices in levels of conservatism in setting lower limits of acceptable values that facilitate interpretation of results.

A Bioinformatics 3D Cellular Morphotyping Strategy for Assessing Biomaterial Scaffold Niches.

Many biomaterial scaffolds have been advanced to provide synthetic cell niches for tissue engineering and drug screening applications; however, current methods for comparing scaffold niches focus on cell functional outcomes or attempt to normalize materials properties between different scaffold formats. We demonstrate a three-dimensional (3D) cellular morphotyping strategy for comparing biomaterial scaffold cell niches between different biomaterial scaffold formats. Primary human bone marrow stromal cells (hBMSCs) were cultured on 8 different biomaterial scaffolds, including fibrous scaffolds, hydrogels, and porous sponges, in 10 treatment groups to compare a variety of biomaterial scaffolds and cell morphologies. A bioinformatics approach was used to determine the 3D cellular morphotype for each treatment group by using 82 shape metrics to analyze approximately 1000 cells. We found that hBMSCs cultured on planar substrates yielded planar cell morphotypes, while those cultured in 3D scaffolds had elongated or equiaxial cellular morphotypes with greater height. Multivariate analysis was effective at distinguishing mean shapes of cells in flat substrates from cells in scaffolds, as was the metric L1-depth (the cell height along its shortest axis after aligning cells with a characteristic ellipsoid). The 3D cellular morphotyping technique enables direct comparison of cellular microenvironments between widely different types of scaffolds and design of scaffolds based on cell structure-function relationships.

Absolute Measurement of Cardiac Injury-Induced microRNAs in Biofluids across Multiple Test Sites.

Extracellular microRNAs (miRNAs) represent a promising new source of toxicity biomarkers that are sensitive indicators of site of tissue injury. In order to establish reliable approaches for use in biomarker validation studies, the HESI technical committee on genomics initiated a multi-site study to assess sources of variance associated with quantitating levels of cardiac injury induced miRNAs in biofluids using RT-qPCR. Samples were generated at a central site using a model of acute cardiac injury induced in male Wistar rats by 0.5 mg/kg isoproterenol. Biofluid samples were sent to 11 sites for measurement of 3 cardiac enriched miRNAs (miR-1-3p, miR-208a-3p, and miR-499-5p) and 1 miRNA abundant in blood (miR-16-5p) or urine (miR-192-5p) by absolute quantification using calibration curves of synthetic miRNAs. The samples included serum and plasma prepared from blood collected at 4 h, urine collected from 6 to 24 h, and plasma prepared from blood collected at 24 h post subcutaneous injection. A 3 parameter logistic model was utilized to fit the calibration curve data and estimate levels of miRNAs in biofluid samples by inverse prediction. Most sites observed increased circulating levels of miR-1-3p and miR-208a-3p at 4 and 24 h after isoproterenol treatment, with no difference seen between serum and plasma. The biological differences in miRNA levels and sample type dominated as sources of variance, along with outlying performance by a few sites. The standard protocol established in this study was successfully implemented across multiple sites and provides a benchmark method for further improvements in quantitative assays for circulating miRNAs.

External RNA Controls Consortium Beta Version Update.

Spike-in RNAs are valuable controls for a variety of gene expression measurements. The External RNA Controls Consortium developed test sets that were used in a number of published reports. Here we provide an authoritative table that summarizes, updates, and corrects errors in the test version that ultimately resulted in the certified Standard Reference Material 2374. We have noted existence of anti-sense RNA controls in the material, corrected sub-pool memberships, and commented on control RNAs that displayed inconsistent behavior.

An international comparability study on quantification of mRNA gene expression ratios: CCQM-P103.1.

Measurement of RNA can be used to study and monitor a range of infectious and non-communicable diseases, with profiling of multiple gene expression mRNA transcripts being increasingly applied to cancer stratification and prognosis. An international comparison study (Consultative Committee for Amount of Substance (CCQM)-P103.1) was performed in order to evaluate the comparability of measurements of RNA copy number ratio for multiple gene targets between two samples. Six exogenous synthetic targets comprising of External RNA Control Consortium (ERCC) standards were measured alongside transcripts for three endogenous gene targets present in the background of human cell line RNA. The study was carried out under the auspices of the Nucleic Acids (formerly Bioanalysis) Working Group of the CCQM. It was coordinated by LGC (United Kingdom) with the support of National Institute of Standards and Technology (USA) and results were submitted from thirteen National Metrology Institutes and Designated Institutes. The majority of laboratories performed RNA measurements using RT-qPCR, with datasets also being submitted by two laboratories based on reverse transcription digital polymerase chain reaction and one laboratory using a next-generation sequencing method. In RT-qPCR analysis, the RNA copy number ratios between the two samples were quantified using either a standard curve or a relative quantification approach. In general, good agreement was observed between the reported results of ERCC RNA copy number ratio measurements. Measurements of the RNA copy number ratios for endogenous genes between the two samples were also consistent between the majority of laboratories. Some differences in the reported values and confidence intervals ('measurement uncertainties') were noted which may be attributable to choice of measurement method or quantification approach. This highlights the need for standardised practices for the calculation of fold change ratios and uncertainties in the area of gene expression profiling.

Evaluation of the External RNA Controls Consortium (ERCC) reference material using a modified Latin square design.

BACKGROUND: Highly multiplexed assays for quantitation of RNA transcripts are being used in many areas of biology and medicine. Using data generated by these transcriptomic assays requires measurement assurance with appropriate controls. Methods to prototype and evaluate multiple RNA controls were developed as part of the External RNA Controls Consortium (ERCC) assessment process. These approaches included a modified Latin square design to provide a broad dynamic range of relative abundance with known differences between four complex pools of ERCC RNA transcripts spiked into a human liver total RNA background. RESULTS: ERCC pools were analyzed on four different microarray platforms: Agilent 1- and 2-color, Illumina bead, and NIAID lab-made spotted microarrays; and two different second-generation sequencing platforms: the Life Technologies 5500xl and the Illumina HiSeq 2500. Individual ERCC controls were assessed for reproducible performance in signal response to concentration among the platforms. Most demonstrated linear behavior if they were not located near one of the extremes of the dynamic range. Performance issues with any individual ERCC transcript could be attributed to detection limitations, platform-specific target probe issues, or potential mixing errors. Collectively, these pools of spike-in RNA controls were evaluated for suitability as surrogates for endogenous transcripts to interrogate the performance of the RNA measurement process of each platform. The controls were useful for establishing the dynamic range of the assay, as well as delineating the useable region of that range where differential expression measurements, expressed as ratios, would be expected to be accurate. CONCLUSIONS: The modified Latin square design presented here uses a composite testing scheme for the evaluation of multiple performance characteristics: linear performance of individual controls, signal response within dynamic range pools of controls, and ratio detection between pairs of dynamic range pools. This compact design provides an economical sample format for the evaluation of multiple external RNA controls within a single experiment per platform. These results indicate that well-designed pools of RNA controls, spiked into samples, provide measurement assurance for endogenous gene expression studies.

Using mixtures of biological samples as process controls for RNA-sequencing experiments.

BACKGROUND: Genome-scale "-omics" measurements are challenging to benchmark due to the enormous variety of unique biological molecules involved. Mixtures of previously-characterized samples can be used to benchmark repeatability and reproducibility using component proportions as truth for the measurement. We describe and evaluate experiments characterizing the performance of RNA-sequencing (RNA-Seq) measurements, and discuss cases where mixtures can serve as effective process controls. RESULTS: We apply a linear model to total RNA mixture samples in RNA-seq experiments. This model provides a context for performance benchmarking. The parameters of the model fit to experimental results can be evaluated to assess bias and variability of the measurement of a mixture. A linear model describes the behavior of mixture expression measures and provides a context for performance benchmarking. Residuals from fitting the model to experimental data can be used as a metric for evaluating the effect that an individual step in an experimental process has on the linear response function and precision of the underlying measurement while identifying signals affected by interference from other sources. Effective benchmarking requires well-defined mixtures, which for RNA-Seq requires knowledge of the post-enrichment 'target RNA' content of the individual total RNA components. We demonstrate and evaluate an experimental method suitable for use in genome-scale process control and lay out a method utilizing spike-in controls to determine enriched RNA content of total RNA in samples. CONCLUSIONS: Genome-scale process controls can be derived from mixtures. These controls relate prior knowledge of individual components to a complex mixture, allowing assessment of measurement performance. The target RNA fraction accounts for differential selection of RNA out of variable total RNA samples. Spike-in controls can be utilized to measure this relationship between target RNA content and input total RNA. Our mixture analysis method also enables estimation of the proportions of an unknown mixture, even when component-specific markers are not previously known, whenever pure components are measured alongside the mixture.

Assessing technical performance in differential gene expression experiments with external spike-in RNA control ratio mixtures.

There is a critical need for standard approaches to assess, report and compare the technical performance of genome-scale differential gene expression experiments. Here we assess technical performance with a proposed standard 'dashboard' of metrics derived from analysis of external spike-in RNA control ratio mixtures. These control ratio mixtures with defined abundance ratios enable assessment of diagnostic performance of differentially expressed transcript lists, limit of detection of ratio (LODR) estimates and expression ratio variability and measurement bias. The performance metrics suite is applicable to analysis of a typical experiment, and here we also apply these metrics to evaluate technical performance among laboratories. An interlaboratory study using identical samples shared among 12 laboratories with three different measurement processes demonstrates generally consistent diagnostic power across 11 laboratories. Ratio measurement variability and bias are also comparable among laboratories for the same measurement process. We observe different biases for measurement processes using different mRNA-enrichment protocols.

Ontology analysis of global gene expression differences of human bone marrow stromal cells cultured on 3D scaffolds or 2D films.

Differences in gene expression of human bone marrow stromal cells (hBMSCs) during culture in three-dimensional (3D) nanofiber scaffolds or on two-dimensional (2D) films were investigated via pathway analysis of microarray mRNA expression profiles. Previous work has shown that hBMSC culture in nanofiber scaffolds can induce osteogenic differentiation in the absence of osteogenic supplements (OS). Analysis using ontology databases revealed that nanofibers and OS regulated similar pathways and that both were enriched for TGF-ß and cell-adhesion/ECM-receptor pathways. The most notable difference between the two was that nanofibers had stronger enrichment for cell-adhesion/ECM-receptor pathways. Comparison of nanofibers scaffolds with flat films yielded stronger differences in gene expression than comparison of nanofibers made from different polymers, suggesting that substrate structure had stronger effects on cell function than substrate polymer composition. These results demonstrate that physical (nanofibers) and biochemical (OS) signals regulate similar ontological pathways, suggesting that these cues use similar molecular mechanisms to control hBMSC differentiation.

The determination of stem cell fate by 3D scaffold structures through the control of cell shape.

Stem cell response to a library of scaffolds with varied 3D structures was investigated. Microarray screening revealed that each type of scaffold structure induced a unique gene expression signature in primary human bone marrow stromal cells (hBMSCs). Hierarchical cluster analysis showed that treatments sorted by scaffold structure and not by polymer chemistry suggesting that scaffold structure was more influential than scaffold composition. Further, the effects of scaffold structure on hBMSC function were mediated by cell shape. Of all the scaffolds tested, only scaffolds with a nanofibrous morphology were able to drive the hBMSCs down an osteogenic lineage in the absence of osteogenic supplements. Nanofiber scaffolds forced the hBMSCs to assume an elongated, highly branched morphology. This same morphology was seen in osteogenic controls where hBMSCs were cultured on flat polymer films in the presence of osteogenic supplements (OS). In contrast, hBMSCs cultured on flat polymer films in the absence of OS assumed a more rounded and less-branched morphology. These results indicate that cells are more sensitive to scaffold structure than previously appreciated and suggest that scaffold efficacy can be optimized by tailoring the scaffold structure to force cells into morphologies that direct them to differentiate down the desired lineage.

An adaptable method using human mixed tissue ratiometric controls for benchmarking performance on gene expression microarrays in clinical laboratories.

BACKGROUND: Molecular biomarkers that are based on mRNA transcripts are being developed for the diagnosis and treatment of a number of diseases. DNA microarrays are one of the primary technologies being used to develop classifiers from gene expression data for clinically relevant outcomes. Microarray assays are highly multiplexed measures of comparative gene expression but have a limited dynamic range of measurement and show compression in fold change detection. To increase the clinical utility of microarrays, assay controls are needed that benchmark performance using metrics that are relevant to the analysis of genomic data generated with biological samples. RESULTS: Ratiometric controls were prepared from commercial sources of high quality RNA from human tissues with distinctly different expression profiles and mixed in defined ratios. The samples were processed using six different target labeling protocols and replicate datasets were generated on high density gene expression microarrays. The area under the curve from receiver operating characteristic plots was calculated to measure diagnostic performance. The reliable region of the dynamic range was derived from log(2) ratio deviation plots made for each dataset. Small but statistically significant differences in diagnostic performance were observed between standardized assays available from the array manufacturer and alternative methods for target generation. Assay performance using the reliable range of comparative measurement as a metric was improved by adjusting sample hybridization conditions for one commercial kit. CONCLUSIONS: Process improvement in microarray assay performance was demonstrated using samples prepared from commercially available materials and two metrics - diagnostic performance and the reliable range of measurement. These methods have advantages over approaches that use a limited set of external controls or correlations to reference sets, because they provide benchmark values that can be used by clinical laboratories to help optimize protocol conditions and laboratory proficiency with microarray assays.

Overview of laser microbeam applications as related to antibody targeting.

This chapter reviews several techniques which combine the use of laser microbeams with antibodies to study molecular and cellular biology. An overview of the basic properties of lasers and their integration with microscopes and computers is provided. Biophysical applications, such as fluorescence recovery after photobleaching to measure molecular mobility and fluorescence resonance energy transfer to measure molecular distances, as well as ablative applications for the selective inactivation of proteins or the selective killing of cells are described. Other techniques, such as optical trapping, that do not rely on the interaction of the laser with the targeting antibody, are also discussed.

Comparison of the diagnostic performance of human whole genome microarrays using mixed-tissue RNA reference samples.

Universal approaches for assessing the diagnostic performance of microarray assays are essential for the application of microarray technology to clinical and regulatory settings. Reference systems for diagnostic assays in laboratory medicine typically involve the utilization of reference samples, metrics, and reference datasets to ensure that measurements are comparable and true. For microarray performance evaluation and process improvement, reference samples can be composed of mixes of different tissue or cell line RNAs that contain tissue-selective analytes at defined target ratios. The diagnostic accuracy of detected changes in expression, measured as the area under the curve from receiver-operating characteristic plots, can provide a single commutable value for comparing assay specificity and sensitivity. Examples of applying this method for assessing overall performance are provided using public datasets generated on five commercial human whole genome microarray platforms for the MicroArray Quality Control project, a community-wide effort to address issues surrounding microarray data reliability.

Assessment of repeated microarray experiments using mixed tissue RNA reference samples.

Genome-scale gene expression technologies are increasingly being applied for biological research as a whole and toxicological screening in particular. In order to monitor data quality and process drift, we adopted the use of two rat-tissue mixtures (brain, liver, kidney, and testis) previously introduced as RNA reference samples. These samples were processed every time a microarray experiment was hybridized, thereby verifying the comparability of the resulting expression data for cross-study comparison. This study presents the analysis of 21 technical replicates of these two mixed-tissue samples using Affymetrix RAE230_2 GeneChip over a period of 12 months. The results show that detection sensitivity, measured by the number of present and absent sequences, is robust, and data correlation, indicated by scatter plots, varies little over time. Receiver operating characteristic (ROC) curves show the sensitivity and specificity of the current measurements are consistent with arrays previously classified as well performing. Overall, this paper shows that the inclusion of standard samples during microarray labeling and hybridization experiments is useful to benchmark the performance of microarray experiments over time and allows discovery of any process drift that, if it occurs, may confound the comparison of these datasets.

Characterization of the effect of sample quality on high density oligonucleotide microarray data using progressively degraded rat liver RNA.

BACKGROUND: The interpretability of microarray data can be affected by sample quality. To systematically explore how RNA quality affects microarray assay performance, a set of rat liver RNA samples with a progressive change in RNA integrity was generated by thawing frozen tissue or by ex vivo incubation of fresh tissue over a time course. RESULTS: Incubation of tissue at 37 degrees C for several hours had little effect on RNA integrity, but did induce changes in the transcript levels of stress response genes and immune cell markers. In contrast, thawing of tissue led to a rapid loss of RNA integrity. Probe sets identified as most sensitive to RNA degradation tended to be located more than 1000 nucleotides upstream of their transcription termini, similar to the positioning of control probe sets used to assess sample quality on Affymetrix GeneChip(R) arrays. Samples with RNA integrity numbers less than or equal to 7 showed a significant increase in false positives relative to undegraded liver RNA and a reduction in the detection of true positives among probe sets most sensitive to sample integrity for in silico modeled changes of 1.5-, 2-, and 4-fold. CONCLUSION: Although moderate levels of RNA degradation are tolerated by microarrays with 3'-biased probe selection designs, in this study we identify a threshold beyond which decreased specificity and sensitivity can be observed that closely correlates with average target length. These results highlight the value of annotating microarray data with metrics that capture important aspects of sample quality.

Improvement in the reproducibility and accuracy of DNA microarray quantification by optimizing hybridization conditions.

BACKGROUND: DNA microarrays, which have been increasingly used to monitor mRNA transcripts at a global level, can provide detailed insight into cellular processes involved in response to drugs and toxins. This is leading to new understandings of signaling networks that operate in the cell, and the molecular basis of diseases. Custom printed oligonucleotide arrays have proven to be an effective way to facilitate the applications of DNA microarray technology. A successful microarray experiment, however, involves many steps: well-designed oligonucleotide probes, printing, RNA extraction and labeling, hybridization, and imaging. Optimization is essential to generate reliable microarray data. RESULTS: Hybridization and washing steps are crucial for a successful microarray experiment. By following the hybridization and washing conditions recommended by an oligonucleotide provider, it was found that the expression ratios were compressed greater than expected and data analysis revealed a high degree of non-specific binding. A series of experiments was conducted using rat mixed tissue RNA reference material (MTRRM) and other RNA samples to optimize the hybridization and washing conditions. The optimized hybridization and washing conditions greatly reduced the non-specific binding and improved the accuracy of spot intensity measurements. CONCLUSION: The results from the optimized hybridization and washing conditions greatly improved the reproducibility and accuracy of expression ratios. These experiments also suggested the importance of probe designs using better bioinformatics approaches and the need for common reference RNA samples for platform performance evaluation in order to fulfill the potential of DNA microarray technology.

Using RNA sample titrations to assess microarray platform performance and normalization techniques.

We have assessed the utility of RNA titration samples for evaluating microarray platform performance and the impact of different normalization methods on the results obtained. As part of the MicroArray Quality Control project, we investigated the performance of five commercial microarray platforms using two independent RNA samples and two titration mixtures of these samples. Focusing on 12,091 genes common across all platforms, we determined the ability of each platform to detect the correct titration response across the samples. Global deviations from the response predicted by the titration ratios were observed. These differences could be explained by variations in relative amounts of messenger RNA as a fraction of total RNA between the two independent samples. Overall, both the qualitative and quantitative correspondence across platforms was high. In summary, titration samples may be regarded as a valuable tool, not only for assessing microarray platform performance and different analysis methods, but also for determining some underlying biological features of the samples.

Workgroup report: Review of genomics data based on experience with mock submissions--view of the CDER Pharmacology Toxicology Nonclinical Pharmacogenomics Subcommittee.

Over the past few years, both the U.S. Food and Drug Administration (FDA) and the pharmaceutical industry have recognized the potential importance of pharmacogenomics and toxicogenomics to drug development. To resolve the uncertainties surrounding the use of microarray technology and the presentation of genomics data for regulatory purposes, several pharmaceutical companies and genomics technology providers have provided the FDA with reports of genomics studies that included supporting toxicology data (e.g., serum chemistry, histopathology). These studies were not associated with any active drug application and were exploratory or hypothesis generating in nature. For training purposes, these reports were reviewed by the Nonclinical Pharmacogenomics Subcommittee consisting of the Center for Drug Evaluation and Research pharmacology and toxicology researchers and reviewers. In this article, we describe some of these submissions and report on our assessment of data content, format, and quality control metrics that were useful for evaluating these nonclinical genomics submissions, specifically in relation to the proposed MIAME/MINTox (minimum information about a microarray experiment/minimum information needed for a toxicology experiment) recommendations. These genomics submissions allowed both researchers and regulators to gain experience in the process of reviewing and analyzing toxicogenomics data. The experience will allow development of recommendations for the submission and review of these data as the state of the science evolves.