Progressive CD4+ central memory T cell decline results in CD4+ effector memory insufficiency and overt disease in chronic SIV infection.

Primary simian immunodeficiency virus (SIV) infections of rhesus macaques result in the dramatic depletion of CD4(+) CCR5(+) effector-memory T (T(EM)) cells from extra-lymphoid effector sites, but in most infections, an increased rate of CD4(+) memory T cell proliferation appears to prevent collapse of effector site CD4(+) T(EM) cell populations and acute-phase AIDS. Eventually, persistent SIV replication results in chronic-phase AIDS, but the responsible mechanisms remain controversial. Here, we demonstrate that in the chronic phase of progressive SIV infection, effector site CD4(+) T(EM) cell populations manifest a slow, continuous decline, and that the degree of this depletion remains a highly significant correlate of late-onset AIDS. We further show that due to persistent immune activation, effector site CD4(+) T(EM) cells are predominantly short-lived, and that their homeostasis is strikingly dependent on the production of new CD4(+) T(EM) cells from central-memory T (T(CM)) cell precursors. The instability of effector site CD4(+) T(EM) cell populations over time was not explained by increasing destruction of these cells, but rather was attributable to progressive reduction in their production, secondary to decreasing numbers of CCR5(-) CD4(+) T(CM) cells. These data suggest that although CD4(+) T(EM) cell depletion is a proximate mechanism of immunodeficiency, the tempo of this depletion and the timing of disease onset are largely determined by destruction, failing production, and gradual decline of CD4(+) T(CM) cells.

Insufficient production and tissue delivery of CD4+ memory T cells in rapidly progressive simian immunodeficiency virus infection.

The mechanisms linking human immunodeficiency virus replication to the progressive immunodeficiency of acquired immune deficiency syndrome are controversial, particularly the relative contribution of CD4+ T cell destruction. Here, we used the simian immunodeficiency virus (SIV) model to investigate the relationship between systemic CD4+ T cell dynamics and rapid disease progression. Of 18 rhesus macaques (RMs) infected with CCR5-tropic SIVmac239 (n=14) or CXCR4-tropic SIVmac155T3 (n=4), 4 of the former group manifested end-stage SIV disease by 200 d after infection. In SIVmac155T3 infections, naive CD4+ T cells were dramatically depleted, but this population was spared by SIVmac239, even in rapid progressors. In contrast, all SIVmac239-infected RMs demonstrated substantial systemic depletion of CD4+ memory T cells by day 28 after infection. Surprisingly, the extent of CD4+ memory T cell depletion was not, by itself, a strong predictor of rapid progression. However, in all RMs destined for stable infection, this depletion was countered by a striking increase in production of short-lived CD4+ memory T cells, many of which rapidly migrated to tissue. In all rapid progressors (P <0.0001), production of these cells initiated but failed by day 42 of infection, and tissue delivery of new CD4+ memory T cells ceased. Thus, although profound depletion of tissue CD4+ memory T cells appeared to be a prerequisite for early pathogenesis, it was the inability to respond to this depletion with sustained production of tissue-homing CD4+ memory T cells that best distinguished rapid progressors, suggesting that mechanisms of the CD4+ memory T cell generation play a crucial role in maintaining immune homeostasis in stable SIV infection.

IL-15 induces CD4 effector memory T cell production and tissue emigration in nonhuman primates.

HIV infection selectively targets CD4+ effector memory T (T EM) cells, resulting in dramatic depletion of CD4+ T cells in mucosal effector sites in early infection. Regeneration of the T EM cell compartment is slow and incomplete, even when viral replication is controlled by antiretroviral therapy (ART). Here, we demonstrate that IL-15 dramatically increases in vivo proliferation of rhesus macaque (RM) CD4+ and CD8+ T EM cells with little effect on the naive or central memory T (T CM) cell subsets, a response pattern that is quite distinct from that of either IL-2 or IL-7. T EM cells produced in response to IL-15 did not accumulate in blood. Rather, 5-bromo-2'-deoxyuridine (BrdU) labeling studies suggest that many of these cells rapidly disperse to extralymphoid effector sites, where they manifest (slow) decay kinetics indistinguishable from that of untreated controls. In RMs with uncontrolled SIV infection and highly activated immune systems, IL-15 did not significantly increase CD4+ T EM cell proliferation, but with virologic control and concomitant reduction in immune activation by ART, IL-15 responsiveness was again observed. These data suggest that therapeutic use of IL-15 in the setting of ART might facilitate specific restoration of the CD4 + T cell compartment that is the primary target of HIV with less risk of exhausting precursor T cell compartments or generating potentially deleterious regulatory subsets.

Precision and linearity targets for validation of an IFNgamma ELISPOT, cytokine flow cytometry, and tetramer assay using CMV peptides.

BACKGROUND: Single-cell assays of immune function are increasingly used to monitor T cell responses in immunotherapy clinical trials. Standardization and validation of such assays are therefore important to interpretation of the clinical trial data. Here we assess the levels of intra-assay, inter-assay, and inter-operator precision, as well as linearity, of CD8+ T cell IFNgamma-based ELISPOT and cytokine flow cytometry (CFC), as well as tetramer assays. RESULTS: Precision was measured in cryopreserved PBMC with a low, medium, or high response level to a CMV pp65 peptide or peptide mixture. Intra-assay precision was assessed using 6 replicates per assay; inter-assay precision was assessed by performing 8 assays on different days; and inter-operator precision was assessed using 3 different operators working on the same day. Percent CV values ranged from 4% to 133% depending upon the assay and response level. Linearity was measured by diluting PBMC from a high responder into PBMC from a non-responder, and yielded R2 values from 0.85 to 0.99 depending upon the assay and antigen. CONCLUSION: These data provide target values for precision and linearity of single-cell assays for those wishing to validate these assays in their own laboratories. They also allow for comparison of the precision and linearity of ELISPOT, CFC, and tetramer across a range of response levels. There was a trend toward tetramer assays showing the highest precision, followed closely by CFC, and then ELISPOT; while all three assays had similar linearity. These findings are contingent upon the use of optimized protocols for each assay.

Ex vivo analysis of T-cell function.

Our ability to analyze T-cell function in vitro has progressed in recent years to include analysis of early signaling events, such as specific protein phosphorylation, intermediate functions, such as degranulation and cytokine production, and later functions, such as proliferation. Many assays are now available to monitor these events, and comparative studies of some of these assays have been published. Major recent developments in this area include the ability to measure T-cell degranulation via cell surface exposure of CD107 and the use of polychromatic flow cytometry to examine multiple phenotypes and functions of responding T cells.

Standardization and optimization of multiparameter intracellular cytokine staining.

Intracellular cytokine staining (ICS) is a common method for rapid quantitation of cytokine-producing antigen-specific T cells. T cell production of IFNgamma in particular, and more recently IL-2 as well, is often taken as a measure of vaccine immunogenicity in experimental vaccine trials. As more fluorochromes become available for use in ICS and other applications detecting intracellular markers, the selection of optimal fluorochrome combinations becomes correspondingly more complicated. Additionally, as more sophisticated flow cytometers become available, more attention is being paid to potential result variability from one instrument to another. This review summarizes an oral presentation given at MASIR 2008, January 30-Feb 1, 2008, in La Plagne, France. We focus on issues associated with multiparameter (>four color) flow cytometry, including matching antibody specificities with available fluorochromes and techniques to optimize fluorochrome combinations. We examine issues specific to intracellular staining as well as broader topics such as instrument setup, experimental controls, sample management, and analysis of multiparameter data sets. Particular emphasis is placed on the use of lyophilized cells, antibodies, beads, peptides, etc. (collectively known as "lyoplates"), which can decrease experiment-to-experiment variability as well as processing time. Most clinical trials compile results from multiple testing sites, using data that was acquired on-site in each location. We present data from two different ongoing multi-laboratory standardization studies, one involving 15 laboratories and one involving nine. We identify issues of variability and, where possible, offer solutions.

Early and delayed benefits of HIV-1 suppression: timeline of recovery of innate immunity effector cells.

OBJECTIVE: The kinetics of recovery for innate immune effectors following antiretroviral therapy are unknown. DESIGN AND METHODS: Multiple sequential cryopreserved samples (viremic and ART-suppressed) from 66 patients enrolled in the Women's Interagency HIV Study or Multicenter AIDS Cohort Study cohorts (median follow-up, 700 days) were analyzed to determine natural killer, dendritic and T-cell changes by flow cytometry. Functional parameters were also measured in a subset of samples. Changes over time were analyzed by mixed-effect modeling based on a linear spline with a single knot at 270 days. RESULTS: Following viral suppression, a rapid rise in CD4 and white blood cell counts and a decline in T-cell activation were confirmed. However, natural killer cell subsets increased after 270 days of therapy, with a negative effect by baseline CD4%. CD123+ plasmacytoid but not myeloid dendritic cells showed a trend to increase during the first 270 days with a positive effect of baseline CD4%; plasmacytoid dendritic cell-induced interferon-alpha production significantly increased by end of follow-up. CONCLUSIONS: The kinetics of natural killer and plasmacytoid dendritic cell recovery are markedly different from those of T-cell subsets, indicative of early and delayed benefits of suppressive regimens.

Phenotype and in vitro function of mature MDDC generated from cryopreserved PBMC of cancer patients are equivalent to those from healthy donors.

BACKGROUND: Monocyte-derived-dendritic-cells (MDDC) are the major DC type used in vaccine-based clinical studies for a variety of cancers. In order to assess whether in vitro differentiated MDDC from cryopreserved PBMC of cancer patients are functionally distinct from those of healthy donors, we compared these cells for their expression of co-stimulatory and functional markers. In addition, the effect of cryopreservation of PBMC precursors on the quality of MDDC was also evaluated using samples from healthy donors. METHODS: Using flow cytometry, we compared normal donors and cancer patients MDDC grown in the presence of GM-CSF+IL-4 (immature MDDC), and GM-CSF+IL-4+TNFalpha+IL-1beta+IL-6+PGE-2 (mature MDDC) for (a) surface phenotype such as CD209, CD83 and CD86, (b) intracellular functional markers such as IL-12 and cyclooxygenase-2 (COX-2), (c) ability to secrete IL-8 and IL-12, and (d) ability to stimulate allogeneic and antigen-specific autologous T cells. RESULTS: Cryopreservation of precursors did affect MDDC marker expression, however, only two markers, CD86 and COX-2, were significantly affected. Mature MDDC from healthy donors and cancer patients up-regulated the expression of CD83, CD86, frequencies of IL-12+ and COX-2+ cells, and secretion of IL-8; and down-regulated CD209 expression relative to their immature counterparts. Compared to healthy donors, mature MDDC generated from cancer patients were equivalent in the expression of nearly all the markers studied and importantly, were equivalent in their ability to stimulate allogeneic and antigen-specific T cells in vitro. CONCLUSION: Our data show that cryopreservation of DC precursors does not significantly affect the majority of the MDDC markers, although the trends are towards reduced expression of co-stimulatory makers and cytokines. In addition, monocytes from cryopreserved PBMC of cancer patients can be fully differentiated into mature DC with phenotype and function equivalent to those derived from healthy donors.

IL6 Signaling in Peripheral Blood T Cells Predicts Clinical Outcome in Breast Cancer.

IL6 is a pleiotropic cytokine with both pro- and anti-inflammatory properties, which acts directly on cancer cells to promote their survival and proliferation. Elevated serum IL6 levels negatively correlate with survival of cancer patients, which is generally attributed to the direct effects of IL6 on cancer cells. How IL6 modulates the host immune response in cancer patients is unclear. Here, we show the IL6 signaling response in peripheral blood T cells is impaired in breast cancer patients and is associated with blunted Th17 differentiation. The mechanism identified involved downregulation of gp130 and IL6Rα in breast cancer patients and was independent of plasma IL6 levels. Importantly, defective IL6 signaling in peripheral blood T cells at diagnosis correlated with worse relapse-free survival. These results indicate that intact IL6 signaling in T cells is important for controlling cancer progression. Furthermore, they highlight a potential for IL6 signaling response in peripheral blood T cells at diagnosis as a predictive biomarker for clinical outcome of breast cancer patients. Cancer Res; 77(5); 1119-26. ©2016 AACR.

VACUTAINER CPT and Ficoll density gradient separation perform equivalently in maintaining the quality and function of PBMC from HIV seropositive blood samples.

BACKGROUND: For immune monitoring studies during HIV vaccine clinical trials, whole blood specimens from HIV seropositive (HIV+) patients may be collected at multiple sites and sent to a central location for peripheral blood mononuclear cell (PBMC) isolation, cryopreservation and functional evaluation. In this study we show a comparison of two PBMC preparation options, Ficoll density gradient separation (Ficoll) and Cell Preparation Tubes (CPT) using shipped whole blood specimens from 19 HIV+ patients (CD4 > 350, viral load < 50). The pre- and post- cryopreservation performance of samples collected by these two methods were compared by assessment of antigen-specific IFNgamma expression in CD8+ and CD8- T cells, cellular viability, and cellular recovery. RESULTS: The results indicate that cryopreserved PBMC samples tested for CMV- and HIV-specific interferon-gamma (IFNgamma) expression performed equivalent to the respective fresh PBMC processed under both collection conditions. Compared to fresh PBMC, the viability was significantly lower for cryopreserved PBMC derived using Ficoll, although it was never less than 90%. There were no significant differences in the IFNgamma response, viability, or recovery between cryopreserved PBMC derived by Ficoll and by CPT. CONCLUSION: These data suggest that CPT is an efficient system for the collection and cryopreservation of functionally active HIV+ PBMC, as well as a viable alternative to Ficoll gradient separation.

Maximizing the retention of antigen specific lymphocyte function after cryopreservation.

The ability to cryopreserve lymphocytes in peripheral blood mononuclear cells (PBMC) to retain their function after thawing is critical to the analysis of cancer immunotherapy studies. We evaluated a variety of cryopreservation strategies with the aim of developing an optimized protocol for freezing and thawing PBMC to retain viability and function. We determined several factors which do not affect cell viability after cryopreservation such as shipping frozen samples on dry ice, the length of time and speed at which samples are washed and centrifuged after thawing, and the number of cells frozen per container. Different media additives, however, did impact the viability of the cells after thawing. There was a significant reduction in the viability of the cells after freezing when using human AB serum compared to all other additives tested (p<0.000). A second critical parameter was the temperature of the media used to wash the cells after removal from the cryotubes. When the media was cooled to 4 degrees C prior to washing, the mean viability was 69.7+/-12.5%, at 25 degrees C 92.55+/-3.1%, and at 37 degrees C 95.11+/-2.5%. Finally, we used an optimized cryopreservation protocol with different media additives to determine if functional T cell responses to tetanus toxoid could be preserved. There was a statistically significant correlation between the tetanus specific stimulation index (S.I.) of the non-cryopreserved PBMC and SI obtained from cells frozen with media containing human serum albumin as compared to other additives such as dextran or fetal bovine serum.

Impact of cryopreservation on tetramer, cytokine flow cytometry, and ELISPOT.

BACKGROUND: Cryopreservation of PBMC and/or overnight shipping of samples are required for many clinical trials, despite their potentially adverse effects upon immune monitoring assays such as MHC-peptide tetramer staining, cytokine flow cytometry (CFC), and ELISPOT. In this study, we compared the performance of these assays on leukapheresed PBMC shipped overnight in medium versus cryopreserved PBMC from matched donors. RESULTS: Using CMV pp65 peptide pool stimulation or pp65 HLA-A2 tetramer staining, there was significant correlation between shipped and cryopreserved samples for each assay (p

Standardization of cytokine flow cytometry assays.

BACKGROUND: Cytokine flow cytometry (CFC) or intracellular cytokine staining (ICS) can quantitate antigen-specific T cell responses in settings such as experimental vaccination. Standardization of ICS among laboratories performing vaccine studies would provide a common platform by which to compare the immunogenicity of different vaccine candidates across multiple international organizations conducting clinical trials. As such, a study was carried out among several laboratories involved in HIV clinical trials, to define the inter-lab precision of ICS using various sample types, and using a common protocol for each experiment (see additional files online). RESULTS: Three sample types (activated, fixed, and frozen whole blood; fresh whole blood; and cryopreserved PBMC) were shipped to various sites, where ICS assays using cytomegalovirus (CMV) pp65 peptide mix or control antigens were performed in parallel in 96-well plates. For one experiment, antigens and antibody cocktails were lyophilised into 96-well plates to simplify and standardize the assay setup. Results ((CD4+)cytokine+ cells and (CD8+)cytokine+ cells) were determined by each site. Raw data were also sent to a central site for batch analysis with a dynamic gating template. Mean inter-laboratory coefficient of variation (C.V.) ranged from 17-44% depending upon the sample type and analysis method. Cryopreserved peripheral blood mononuclear cells (PBMC) yielded lower inter-lab C.V.'s than whole blood. Centralized analysis (using a dynamic gating template) reduced the inter-lab C.V. by 5-20%, depending upon the experiment. The inter-lab C.V. was lowest (18-24%) for samples with a mean of > 0.5% IFNgamma + T cells, and highest (57-82%) for samples with a mean of < 0.1% IFNgamma + cells. CONCLUSION: ICS assays can be performed by multiple laboratories using a common protocol with good inter-laboratory precision, which improves as the frequency of responding cells increases. Cryopreserved PBMC may yield slightly more consistent results than shipped whole blood. Analysis, particularly gating, is a significant source of variability, and can be reduced by centralized analysis and/or use of a standardized dynamic gating template. Use of pre-aliquoted lyophilized reagents for stimulation and staining can provide further standardization to these assays.

T cell immunity to HIV: defining parameters of protection.

In recent years, CD4 and CD8 T cell responses to HIV and SIV infection have been increasingly measured with the use of single-cell assays such as ELISPOT, MHC-peptide oligomers, and cytokine flow cytometry. The results of these assays have been compared to those obtained with traditional bulk assays such as lymphoproliferation (by 3H-thymidine incorporation) and cytotoxicity (by 51Cr release). Such comparisons have led to some general understanding of the T cell responses that characterize progressive disease, long-term non-progressors, and individuals with viral suppression achieved by anti-retroviral therapy. In addition, prophylactic and therapeutic vaccine trials have also begun to use these assays of T cell immunity to gauge the immunogenicity of the vaccines. Whether such analyses will allow us to pick the best vaccine constructs, and whether they will provide us with an improved understanding of what constitutes protective cellular immunity to HIV, are major questions for the field. These questions will be examined in this review from the standpoint of current data and comparisons to other viral diseases. It is hypothesized that sophisticated multiparametric assays will be required to sort out the factors relevant for protective immunity in this complex disease. These parameters may include functional avidity, epitope breadth and specificity, proliferative capacity, cytokine repertoire, degree of anergy, and differentiation phenotype, as well as magnitude, of HIV-specific CD4 and CD8 T cells.

Performance of plate-based cytokine flow cytometry with automated data analysis.

BACKGROUND: Cytokine flow cytometry (CFC) provides a multiparameter alternative to ELISPOT assays for rapid quantitation of antigen-specific T cells. To increase the throughput of CFC assays, we have optimized methods for stimulating, staining, and acquiring whole blood or PBMC samples in 96-well or 24-well plates. RESULTS: We have developed a protocol for whole blood stimulation and processing in deep-well 24- or 96-well plates, and fresh or cryopreserved peripheral blood mononuclear cell (PBMC) stimulation and processing in conventional 96-well round-bottom plates. Samples from both HIV-1-seronegative and HIV-1-seropositive donors were tested. We show that the percent response, staining intensity, and cell recovery are comparable to stimulation and processing in tubes using traditional methods. We also show the equivalence of automated gating templates to manual gating for CFC data analysis. CONCLUSION: When combined with flow cytometry analysis using an automated plate loader and an automated analysis algorithm, these plate-based methods provide a higher throughput platform for CFC, as well as reducing operator-induced variability. These factors will be important for processing the numbers of samples required in large clinical trials, and for epitope mapping of patient responses.

Analyzing T-cell responses to cytomegalovirus by cytokine flow cytometry.

T-cell responses to human cytomegalovirus (CMV) are readily detected in chronically infected adults, and are thought to be important for protection from CMV-related pathology. Antigen-specific cytokine flow cytometry (CFC) has been used to establish the range of CMV-specific CD4 and CD8 T-cell frequencies in healthy CMV-seropositive (and seronegative) adults, as well as the dynamics of these cells over time. There are also emerging data regarding the primary CD4 and CD8 T-cell response to CMV in children and adults. Finally, CFC has been used to analyze CMV responses in chronic human immunodeficiency virus infection, as well as during immune reconstitution after bone marrow or stem cell transplantation. These data will be reviewed in terms of what they suggest about the threshold of protective T-cell immunity to CMV, and other factors in addition to T-cell frequencies that could be important in protecting from CMV-associated disease.

Probability state modeling of memory CD8⁺ T-cell differentiation.

Flow cytometric analysis enables the simultaneous single-cell interrogation of multiple biomarkers for phenotypic and functional identification of heterogeneous populations. Analysis of polychromatic data has become increasingly complex with more measured parameters. Furthermore, manual gating of multiple populations using standard analysis techniques can lead to errors in data interpretation and difficulties in the standardization of analyses. To characterize high-dimensional cytometric data, we demonstrate the use of probability state modeling (PSM) to visualize the differentiation of effector/memory CD8⁺ T cells. With this model, four major CD8⁺ T-cell subsets can be easily identified using the combination of three markers, CD45RA, CCR7 (CD197), and CD28, with the selection markers CD3, CD4, CD8, and side scatter (SSC). PSM enables the translation of complex multicolor flow cytometric data to pathway-specific cell subtypes, the capability of developing averaged models of healthy donor populations, and the analysis of phenotypic heterogeneity. In this report, we also illustrate the heterogeneity in memory T-cell subpopulations as branched differentiation markers that include CD127, CD62L, CD27, and CD57.

VTX-2337 is a novel TLR8 agonist that activates NK cells and augments ADCC.

PURPOSE: We aim to characterize VTX-2337, a novel Toll-like receptor (TLR) 8 agonist in clinical development, and investigate its potential to improve monoclonal antibody-based immunotherapy that includes the activation of natural killer (NK) cells. EXPERIMENTAL DESIGN: HEK-TLR transfectants were used to compare the selectivity and potency of VTX-2337, imiquimod, CpG ODN2006, and CL075. The ability of VTX-2337 to induce cytokine and chemokine production from human peripheral blood mononuclear cells (PBMC) and activation of specific immune cell subsets was examined. The potential for VTX-2337 to activate NK cell activity through direct and indirect mechanisms was also investigated. Finally, we tested the potential for VTX-2337 to augment antibody-dependent cell-mediated cytotoxicity (ADCC), especially in individuals with low-affinity FcγR3A single-nucleotide polymorphism (SNP). RESULTS: VTX-2337 selectively activates TLR8 with an EC(50) of about 100 nmol/L and stimulates production of TNFα and interleukin (IL)-12 from monocytes and myeloid dendritic cells (mDC). VTX-2337 stimulates IFNγ production from NK cells and increases the cytotoxicity of NK cells against K562 and ADCC by rituximab and trastuzumab. Effects of VTX-2337 on NK cells were, in part, from direct activation as increased IFNγ production and cytotoxic activity were seen with purified NK cells. Finally, VTX-2337 augments ADCC by rituximab in PBMCs with different FcγR3A genotypes (V/V, V/F, and F/F at position 158). CONCLUSIONS: VTX-2337 is a novel small-molecule TLR8 agonist that activates monocytes, DCs, and NK cells. Through the activation of NK cells, it has the potential to augment the effectiveness of monoclonal antibody treatments where a polymorphism in FcγR3A limits clinical efficacy.

Flow cytometric analysis of cell signaling proteins.

In recent years, techniques that combine the use of phospho-specific antibodies and multiparameter flow cytometry have been developed for the detection of protein phosphorylation at the single cell level. Flow cytometry is uniquely suited for this type of analysis, as it can measure functional and phenotypic markers in the context of complex cell populations. Phosphorylation can be assessed simultaneously in multiple cell subsets, and due to the small sample sizes required, and the rapid analyses of large numbers of cells in this approach, rare cell analysis is possible without the ex vivo expansion of cells.In this chapter, we detail flow cytometric protocols for the detection of intracellular phospho-proteins in samples derived from whole blood and peripheral blood mononuclear cell preparations. These protocols define steps for cell activation, fixation, permeabilization, and staining by phospho-specific and phenotyping antibodies. We discuss technical difficulties inherent to this technique and suggest solutions to commonly encountered problems. Additionally, we show examples of phospho-protein detection in lymphocyte subsets, dendritic cells, and monocytes activated with various stimuli, including mitogens, cytokines, and superantigens. Finally, we highlight a potential clinical trial application for this flow cytometric assay as a platform for pharmacodynamic monitoring of kinase inhibitors.

Quality assurance of intracellular cytokine staining assays: analysis of multiple rounds of proficiency testing.

When evaluating candidate prophylactic HIV and cancer vaccines, intracellular cytokine staining (ICS) assays that measure the frequency and magnitude of antigen-specific T-cell subsets are one tool to monitor immunogen performance and make product advancement decisions. To assess the inter-laboratory assay variation among multiple laboratories testing vaccine candidates, the NIH/NIAID/DAIDS in collaboration with BD Biosciences implemented an ICS Quality Assurance Program (QAP). Seven rounds of testing have been conducted in which 16 laboratories worldwide participated. In each round, IFN-γ, IL-2 and/or TNF-α responses in CD4+ and CD8+ T-cells to CEF or CMV pp65 peptide mixes were tested using cryopreserved peripheral blood mononuclear cells (PBMC) from CMV seropositive donors. We found that for responses measured above 0.2%, inter-laboratory %CVs were, on average, 35%. No differences in inter-laboratory variation were observed if a 4-color antibody cocktail or a 7-color combination was used. Moreover, the data allowed identification of important sources of variability for flow cytometry-based assays, including: number of collected events, gating strategy and instrument setup and performance. As a consequence, in this multi-site study we were able to define pass and fail criteria for ICS assays, which will be adopted in the subsequent rounds of testing and could be easily extrapolated to QAP for other flow cytometry-based assays.