Hit selection with false discovery rate control in genome-scale RNAi screens.

RNA interference (RNAi) is a modality in which small double-stranded RNA molecules (siRNAs) designed to lead to the degradation of specific mRNAs are introduced into cells or organisms. siRNA libraries have been developed in which siRNAs targeting virtually every gene in the human genome are designed, synthesized and are presented for introduction into cells by transfection in a microtiter plate array. These siRNAs can then be transfected into cells using high-throughput screening (HTS) methodologies. The goal of RNAi HTS is to identify a set of siRNAs that inhibit or activate defined cellular phenotypes. The commonly used analysis methods including median +/- kMAD have issues about error rates in multiple hypothesis testing and plate-wise versus experiment-wise analysis. We propose a methodology based on a Bayesian framework to address these issues. Our approach allows for sharing of information across plates in a plate-wise analysis, which obviates the need for choosing either a plate-wise or experimental-wise analysis. The proposed approach incorporates information from reliable controls to achieve a higher power and a balance between the contribution from the samples and control wells. Our approach provides false discovery rate (FDR) control to address multiple testing issues and it is robust to outliers.

Identification of small-molecule modulators of mouse SVZ progenitor cell proliferation and differentiation through high-throughput screening.

Adult mouse subventricular zone (SVZ) neural stem/progenitor cells are multipotent self-renewing cells that retain the capacity to generate the major cell types of the central nervous system in vitro and in vivo. The relative ease of expanding SVZ cells in culture as neurospheres makes them an ideal model for carrying out large-scale screening to identify compounds that regulate neural progenitor cell proliferation and differentiation. The authors have developed an adenosine triphosphate-based cell proliferation assay using adult SVZ cells to identify small molecules that activate or inhibit progenitor cell proliferation. This assay was miniaturized to a 1536-well format for high-throughput screening (HTS) of >1 million small-molecule compounds, and 325 and 581 compounds were confirmed as potential inducers of SVZ cell proliferation and differentiation, respectively. A number of these compounds were identified as having a selective proliferative and differentiation effect on SVZ cells versus mouse Neuro2a neuroblastoma cells. These compounds can potentially be useful pharmacological tools to modulate resident stem cells and neurogenesis in the adult brain. This study represents a novel application of primary somatic stem cells in the HTS of a large-scale compound library.

Small interfering RNA screens reveal enhanced cisplatin cytotoxicity in tumor cells having both BRCA network and TP53 disruptions.

RNA interference technology allows the systematic genetic analysis of the molecular alterations in cancer cells and how these alterations affect response to therapies. Here we used small interfering RNA (siRNA) screens to identify genes that enhance the cytotoxicity (enhancers) of established anticancer chemotherapeutics. Hits identified in drug enhancer screens of cisplatin, gemcitabine, and paclitaxel were largely unique to the drug being tested and could be linked to the drug's mechanism of action. Hits identified by screening of a genome-scale siRNA library for cisplatin enhancers in TP53-deficient HeLa cells were significantly enriched for genes with annotated functions in DNA damage repair as well as poorly characterized genes likely having novel functions in this process. We followed up on a subset of the hits from the cisplatin enhancer screen and validated a number of enhancers whose products interact with BRCA1 and/or BRCA2. TP53(+/-) matched-pair cell lines were used to determine if knockdown of BRCA1, BRCA2, or validated hits that associate with BRCA1 and BRCA2 selectively enhances cisplatin cytotoxicity in TP53-deficient cells. Silencing of BRCA1, BRCA2, or BRCA1/2-associated genes enhanced cisplatin cytotoxicity approximately 4- to 7-fold more in TP53-deficient cells than in matched TP53 wild-type cells. Thus, tumor cells having disruptions in BRCA1/2 network genes and TP53 together are more sensitive to cisplatin than cells with either disruption alone.

An efficient and fully automated high-throughput transfection method for genome-scale siRNA screens.

RNA interference (RNAi), combined with the availability of genome sequences, provides an unprecedented opportunity for the massive and parallel investigations of gene function. Small interfering RNA (siRNA) represents a popular and quick approach of RNAi for in vitro loss-of-function genetic screens. Efficient transfection of siRNA is critical for unambiguous interpretation of screen results and thus overall success of any siRNA screen. A high-throughput, lipid-based transfection method for siRNA was developed that can process eighty 384-well microplates in triplicate (for a total of 30,720 unique transfections) in 8 h. Transfection throughput was limited only by the speed of robotics, whereas the cost of screening was reduced. As a proof of principle, a genome-scale screen with a library of 22,108 siRNAs was performed to identify the genes sensitizing cells to mitomycin C at concentrations of 0, 20, and 60 nM. Transfection efficiency, performances of control siRNAs, and other quality metrics were monitored and demonstrated that the new, optimized transfection protocol produced high-quality results throughout the screen.

Median absolute deviation to improve hit selection for genome-scale RNAi screens.

High-throughput screening (HTS) of large-scale RNA interference (RNAi) libraries has become an increasingly popular method of functional genomics in recent years. Cell-based assays used for RNAi screening often produce small dynamic ranges and significant variability because of the combination of cellular heterogeneity, transfection efficiency, and the intrinsic nature of the genes being targeted. These properties make reliable hit selection in the RNAi screen a difficult task. The use of robust methods based on median and median absolute deviation (MAD) has been suggested to improve hit selection in such cases, but mean and standard deviation (SD)-based methods are still predominantly used in many RNAi HTS. In an experimental approach to compare these 2 methods, a genome-scale small interfering RNA (siRNA) screen was performed, in which the identification of novel targets increasing the therapeutic index of the chemotherapeutic agent mitomycin C (MMC) was sought. MAD values were resistant to the presence of outliers, and the hits selected by the MAD-based method included all the hits that would be selected by SD-based method as well as a significant number of additional hits. When retested in triplicate, a similar percentage of these siRNAs were shown to genuinely sensitize cells to MMC compared with the hits shared between SD- and MAD-based methods. Confirmed hits were enriched with the genes involved in the DNA damage response and cell cycle regulation, validating the overall hit selection strategy. Finally, computer simulations showed the superiority and generality of the MAD-based method in various RNAi HTS data models. In conclusion, the authors demonstrate that the MAD-based hit selection method rescued physiologically relevant false negatives that would have been missed in the SD-based method, and they believe it to be the desirable 1st-choice hit selection method for RNAi screen results.

Integrating experimental and analytic approaches to improve data quality in genome-wide RNAi screens.

RNA interference (RNAi) not only plays an important role in drug discovery but can also be developed directly into drugs. RNAi high-throughput screening (HTS) biotechnology allows us to conduct genome-wide RNAi research. A central challenge in genome-wide RNAi research is to integrate both experimental and computational approaches to obtain high quality RNAi HTS assays. Based on our daily practice in RNAi HTS experiments, we propose the implementation of 3 experimental and analytic processes to improve the quality of data from RNAi HTS biotechnology: (1) select effective biological controls; (2) adopt appropriate plate designs to display and/or adjust for systematic errors of measurement; and (3) use effective analytic metrics to assess data quality. The applications in 5 real RNAi HTS experiments demonstrate the effectiveness of integrating these processes to improve data quality. Due to the effectiveness in improving data quality in RNAi HTS experiments, the methods and guidelines contained in the 3 experimental and analytic processes are likely to have broad utility in genome-wide RNAi research.

A 1,536-well [(35)S]GTPgammaS scintillation proximity binding assay for ultra-high-throughput screening of an orphan galphai-coupled GPCR.

Members of the superfamily of seven transmembrane receptors, known as G protein-coupled receptors (GPCRs), are important targets for many therapeutic areas in drug discovery. A homogeneous guanosine 5'-O-(3-[(35)S]thio)triphosphate ([(35)S]GTPgammaS) scintillation proximity assay (SPA) binding assay targeting a Galphai-coupled GPCR recombinantly expressed in membranes of Chinese hamster ovary (CHO) cells was developed and miniaturized into 1,536-well plate format. The primary ultra-high-throughput screen of the entire compound collection was accomplished on the Kalypsys (San Diego, CA) robotic platform at a concentration of 8 muM using the 1,536-well [(35)S]GTPgammaS SPA binding functional assay. The signal-to-noise ratio of the primary screen was approximately 2.1-fold, and the plate coefficient of variation for the compound field was approximately 11%. The hit rate from the primary screen for receptor agonists at >35% activity was approximately 0.3%. Primary hits were cherry-picked, confirmed in triplicate, counterscreened against untransfected CHO cell membranes, and further analyzed in a cyclic AMP functional assay, resulting in 34 leads for optimization.

Miniaturization and HTS of a FRET-based membrane potential assay for K(ir) channel inhibitors.

The K(ir) family of potassium-selective ion channels is characterized by their inward (anomalous) rectifying current-voltage relationship. K(ir) channels are widely expressed in mammalian cells and through their role in regulation of the cell membrane potential have been implicated in diverse physiological functions. To enable the identification of novel K(ir) channel inhibitors, a fluorescence resonance energy transfer (FRET)-based membrane potential assay was developed using a Chinese hamster ovary cell line stably expressing a human K(ir) channel. The FRET-based assay incorporates the use of two dyes {N-(6-chloro-7-hydroxycoumarin-3-carbonyl)-dimyristoylphosphatidylethanolamine (CC2-DMPE) and bis(1,3-diethylthiobarbiturate)trimethine oxonol [DiSBAC(2)(3)]} to track changes in membrane potential, thus enabling all of the advantages of ratiometric readout: reduced inaccuracies arising from well-to-well variation in cell number, dye loading, signal intensities, and plate inconsistencies. The assay was miniaturized to a 1,536-well microtiter plate format and read on a fluorometric imaging plate reader (FLIPR(Tetra), Molecular Devices, Sunnyvale, CA). The assay was automated and utilized to perform a primary high-throughput screening campaign to identify novel inhibitors of the K(ir) channel.

A fluorescence-based thiol quantification assay for ultra-high-throughput screening for inhibitors of coenzyme A production.

Here we report the development and miniaturization of a cell-free enzyme assay for ultra-high-throughput screening (uHTS) for inhibitors of two potential drug targets for obesity and cancer: fatty acid synthase (FAS) and acetyl-coenzyme A (CoA) carboxylase (ACC) 2. This assay detects CoA, a product of the FAS-catalyzed condensation of malonyl-CoA and acetyl-CoA. The free thiol of CoA can react with 7-diethylamino-3-(4'-maleimidylphenyl)-4-methylcoumarin (CPM), a profluorescent coumarin maleimide derivative that becomes fluorescent upon reaction with thiols. FAS produces long-chain fatty acid and CoA from the condensation of malonyl-CoA and acetyl-CoA. In our FAS assay, CoA released in the FAS reaction forms a fluorescence adduct with CPM that emits at 530 nm when excited at 405 nm. Using this detection method for CoA, we measured the activity of sequential enzymes in the fatty acid synthesis pathway to develop an ACC2/FAS-coupled assay where ACC2 produces malonyl-CoA from acetyl-CoA. We miniaturized the FAS and ACC2/FAS assays to 3,456- and 1,536-well plate format, respectively, and completed uHTSs for small molecule inhibitors of this enzyme system. This report shows the results of assay development, miniaturization, and inhibitor screening for these potential drug targets.

The use of strictly standardized mean difference for hit selection in primary RNA interference high-throughput screening experiments.

RNA interference (RNAi) high-throughput screening (HTS) has been hailed as the 2nd genomics wave following the 1st genomics wave of gene expression microarrays and single-nucleotide polymorphism discovery platforms. Following an RNAi HTS, the authors are interested in identifying short interfering RNA (siRNA) hits with large inhibition/activation effects. For hit selection, the z-score method and its variants are commonly used in primary RNAi HTS experiments. Recently, strictly standardized mean difference (SSMD) has been proposed to measure the siRNA effect represented by the magnitude of difference between an siRNA and a negative reference group. The links between SSMD and d+-probability offer a clear interpretation of siRNA effects from a probability perspective. Hence, SSMD can be used as a ranking metric for hit selection. In this article, the authors investigated both the SSMD-based testing process and the use of SSMD as a ranking metric for hit selection in 2 primary siRNA HTS experiments. The analysis results showed that, as a ranking metric, SSMD was more stable and reliable than percentage inhibition and led to more robust hit selection results. Using the SSMD -based testing method, the false-negative rate can more readily be obtained. More important, the use of the SSMD-based method can result in a reduction in both the false-negative and false-positive rates. The applications presented in this article demonstrate that the SSMD method addresses scientific questions and fills scientific needs better than both percentage inhibition and the commonly used z-score method for hit selection.

Ultra-high-throughput screening for antagonists of a Gi-coupled receptor in a 2.2-microl 3,456-well plate format cyclicAMP assay.

3',5'-Cyclic adenosine monophosphate (cAMP) is a common intracellular second messenger that enables cells to respond to external stimuli. Measurement of intracellular cAMP concentrations is thus widely used for studying guanosine triphosphate binding protein-coupled receptors (GPCRs), which make up a large class of pharmaceutical drug targets. Although several assay technologies exist to measure cAMP, most are not suitable for ultra-high-throughput screening (uHTS), as is often required for screening large (greater than 1 million) chemical libraries for the identification of suitable leads for drug development. Here we report that the enzyme fragment complementation assay, a homogeneous gain of signal assay based on complementation of two fragments of a beta-galactosidase enzyme, is compatible with uHTS requirements of a 2.2-microl total assay volume in 3,456-well plate format. We describe the miniaturization of this assay into 3,456-well plate format exhibiting comparable sensitivity and plate statistics to those of a 384-well assay and the application of this assay in uHTS for the identification of antagonists of a Gi-coupled receptor.

Miniaturization and automation of an ubiquitin ligase cascade enzyme-linked immunosorbent assay in 1,536-well format.

Enzyme-linked immunosorbent assays (ELISAs) are a long established and widely used assay format for drug discovery and diagnostics. They offer many advantages over homogeneous assay formats, including high sensitivity and separation (wash) steps that remove detection-interfering compounds. Many high-throughput screening assays are now performed in miniaturized formats (1,536- and 3,456-well plates) for higher throughput and lower reagent consumption. With miniaturization, separation steps in assays such as ELISA can become difficult to implement. Here we report on the implementation of the Kalypsys, Inc. (San Diego, CA) 1,536-well plate washer to enable the successful miniaturization and full automation of an ELISA that monitors ubiquitin ligase activity. The 1,536-well plate ELISA was robust and used for the high-throughput screening of a large screening collection (>1 million compounds).

A cell-based ultra-high-throughput screening assay for identifying inhibitors of D-amino acid oxidase.

Enzymes are often considered less "druggable" targets than ligand-regulated proteins such as G-protein-coupled receptors, ion channels, or other hormone receptors. Reasons for this include cellular location (intracellular vs. cell surface), typically lower affinities for the binding of small molecules compared to ligand-specific receptors, and binding (catalytic) sites that are often charged or highly polar. A practical drawback to the discovery of compounds targeting enzymes is that screening of compound libraries is typically carried out in cell-free activity assays using purified protein in an inherently artificial environment. Cell-based assays, although often arduous to design for enzyme targets, are the preferred discovery tool for the screening of large compound libraries. The authors have recently described a novel cell-based approach to screening for inhibitors of a phosphatase enzyme and now report on the development and implementation of a homogeneous 3456-well plate assay for D-amino acid oxidase (DAO). Human DAO was stably expressed in Chinese hamster ovary (CHO) cells, and its activity was measured as the amount of hydrogen peroxide detected in the growth medium following feeding the cells with D-serine. In less than 12 weeks, the authors proved the concept in 96-and then 384-well formats, miniaturized the assay to the 3456-well (nanoplate) scale, and screened a library containing more than 1 million compounds. They have identified several cell-permeable inhibitors of DAO from this cell-based high-throughput screening, which provided the discovery program with a few novel and attractive lead structures.

A short-incubation reporter-gene assay for high-throughput screening of estrogen receptor-alpha antagonists.

Estrogen receptor (ER) alpha and beta are ligand-activated nuclear transcription factors that mediate the effects of the steroid hormone 17beta-estradiol. Tissue-selective ER modulators have been developed for the treatment of a variety of diseases, including osteoporosis and hormone-dependent breast cancer. Second- and third-generation selective ER modulators are in development, with the goal of reducing toxicity and improving tissue-selective efficacy. Novel tissue-selective and ERsubtype specific ligands may have the potential of providing a new paradigm for maintaining the health of women. The traditional cell-based screening assays for nuclear receptors require 16-18 h of incubation, which limits the assay miniaturization for ultra-high-throughput screening. We have developed a new cell-based ERalpha transactivation assay for the screening of ERalpha-specific antagonists with only 4 h of incubation time. The assay was optimized and used for a fully automated ultrahigh-throughput screen in 3,456-well nanoplate format. The screening throughput was 250,000-300,000 compounds per day, and a number of valuable leads were identified.

Application of division arrest technology to cell-based HTS: comparison with frozen and fresh cells.

Cell-based functional assays are becoming popular in many HTS laboratories because of recent advances in detection and automation technologies. However, the supply of large amounts of live cells with consistent cellular response for day-to-day screening operations over several days/weeks is a tremendous challenge. The high cost of cell culture, labor-intensive nature of the work, and inherent variability in cellular responses from time to time tend to be prohibitive for extensive applications of cell-based assays in HTS. We therefore tested division-arrested cells that were prepared in a single batch and frozen at -80 degrees C before use in several cell-based assays and in a robotic screening campaign. Chinese hamster ovary cells expressing a Gq-coupled receptor were analyzed for the agonist-induced intracellular Ca2+ response measured on a fluorescent imaging plate reader. In this case, the division-arrested cells showed consistent agonist-induced intracellular Ca2+ concentration response as reflected by signal-to-basal ratio and EC50 even 48 h after cell plating. In comparison, the responses from untreated frozen cells and fresh cells declined significantly approximately 30 h after cell plating. In other cell-based assays tested (cyclic AMP assay, reporter gene beta-lactamase assay, and ion-channel assay), the division-arrested cells performed as well as frozen, or fresh cells. We thus conclude that the use of alternate strategies such as frozen cells or division-arrested cells may alleviate the need for several batches of cell plating each day during HTS while maintaining the desired robotic throughput and assay quality.

High-throughput screening of 11beta-hydroxysteroid dehydrogenase type 1 in scintillation proximity assay format.

11beta-Hydroxysteroid dehydrogenase type-1 (11beta-HSD1) is a potential target for the treatment of diabetes, obesity, and hyperlipidemia. This enzyme is mainly responsible for reactivating glucocorticoid hormone inside cells such as adipose cells and liver cells by converting the inactive cortisone to active cortisol. Enzyme assays for 11beta-HSD1 involve either a thin-layer chromatography or high-performance liquid chromatography step to separate cortisol from the substrate cortisone. This additional step is labor intensive and increases the assay time, which limits assay throughput. A homogenous scintillation proximity assay-based method has been recently developed that enables high-throughput screening of 11beta-HSD1 inhibitors. We have applied this novel 11beta-HSD1 assay to screening a large-size compound collection and identified several structural classes of lead compounds that selectively inhibit the activity of 11beta-HSD1.

A rational utilization of high-throughput screening affords selective, orally bioavailable 1-benzyl-3-carboxyazetidine sphingosine-1-phosphate-1 receptor agonists.

Moderately potent, selective S1P(1) receptor agonists identified from high-throughput screening have been adapted into lipophilic tails for a class of orally bioavailable amino acid-based S1P(1) agonists represented by 7. Many of the new compounds are potent S1P(1) agonists that select against the S1P(2), S1P(3), and S1P(4) (although not S1P(5)) receptor subtypes. Analogues 18 and 24 are highly orally bioavailable and possess excellent pharmacokinetic profiles in the rat, dog, and rhesus monkey.

Miniaturization of intracellular calcium functional assays to 1536-well plate format using a fluorometric imaging plate reader.

The measurement of intracellular calcium response transients in living mammalian cells is a popular functional assay for identification of agonists and antagonists to receptors or channels of pharmacological interest. In recent years, advances in fluorescence-based detection techniques and automation technologies have facilitated the adaptation of this assay to 384-well microplate format high-throughput screening (HTS) assays. However, the cost and time required performing the intracellular calcium HTS assays in the 384-well format can be prohibitive for HTS campaigns of greater than 1 x 10(6) wells. For these reasons, it is attractive to miniaturize intracellular calcium functional assays to the 1536-well microplate format, where assay volumes and plate throughput can be decreased by several fold. The focus of the research described in this article is the miniaturization of an intracellular calcium assay to 1536-well plate format. This was accomplished by modifying the hardware and software of a fluorometric imaging plate reader (FLIPR) to enable transfer of nanoliters of test compound directly to a 1536-well assay plate, and measure the resulting calcium response from all 1536 wells simultaneously. An intracellular calcium functional assay against the rat muscarinic acetylcholine receptor subtype 1 (rmAchR1) G-protein coupled receptor (GPCR) was miniaturized and executed on this modified instrument. In experiments measuring the activity of known muscarinic receptor agonists and antagonists, the miniaturized FLIPR assay gave EC(50) and IC(50) values and rank order potency comparable to the 384-well format assays. Calculated Z' factors for the miniaturized agonist and antagonist assays were, respectively, 0.56 +/- 0.21 and 0.53 +/- 0.22, which were slightly higher (Z'(agonist) = 0.55 +/- 0.33) and lower (Z'(antagonist) = 0.70 +/- 0.18) than the corresponding values in the 384-well assays. A mock agonist HTS campaign against the muscarinic receptor in miniaturized format was able to identify all wells spiked with the rmAchR1 agonist carbachol.

High-throughput cell-based screening using scintillation proximity assay for the discovery of inositol phosphatase inhibitors.

Inositol monophosphatase is a potential drug target for developing lithium-mimetic agents for the treatment of bipolar disorder. Enzyme-based assays have been traditionally used in compound screening to identify inositol monophosphatase inhibitors. A cell-based screening assay in which the compound needs to cross the cell membrane before reaching the target enzyme offers a new approach for discovering novel structure leads of the inositol monophosphatase inhibitor. The authors have recently reported a high-throughput measurement of G-protein-coupled receptor activation by determining inositol phosphates in cell extracts using scintillation proximity assay. This cell-based assay has been modified to allow the determination of inositol monophosphatase activity instead of G-protein-coupled receptors. The enzyme is also assayed in its native form and physiological environment. The authors have applied this cell-based assay to the high-throughput screening of a large compound collection and identified several novel inositol monophosphatase inhibitors.

A collaborative screening program for the discovery of inhibitors of HCV NS2/3 cis-cleaving protease activity.

This report describes the development of a cell-based assay for high-throughput screening and detection of small-molecule inhibitors for hepatitis C virus (HCV) NS2/3 protease. The HCV NS2/3 protease is essential for the normal infectious cycle of HCV. Generation of a cell-based assay for this cis-acting viral protease involved reporter constructs in which the NS2/3 protease sequence was inserted between the ,B-lactamase (BLA) reporter and a ubiquitin-based destabilization domain. In stable cell lines, NS2/3 cis cleavage of the NS2/3-BLA fusion protein resulted in differential stability of the cleaved versus uncleaved BLA reporter, providing a robust readout for protease activity. BLA reporter activity was shown to be a function of NS2/3-specific protease activity, by using genetic mutants of the NS2/3 sequence. In addition, the cell-based assay was validated and screened in a 384-well format on a fully automated robotic platform where small-molecule inhibitors of NS2/3 protease activity were identified.