Development of a Cell-Based SARS-CoV-2 Pseudovirus Neutralization Assay Using Imaging and Flow Cytometry Analysis.

COVID-19 is an ongoing, global pandemic caused by the novel, highly infectious SARS-CoV-2 virus. Efforts to mitigate the effects of SARS-CoV-2, such as mass vaccination and development of monoclonal therapeutics, require precise measurements of correlative, functional neutralizing antibodies that block virus infection. The development of rapid, safe, and easy-to-use neutralization assays is essential for faster diagnosis and treatment. Here, we developed a vesicular stomatitis virus (VSV)-based neutralization assay with two readout methods, imaging and flow cytometry, that were capable of quantifying varying degrees of neutralization in patient serum samples. We tested two different spike-pseudoviruses and conducted a time-course assay at multiple multiplicities of infection (MOIs) to optimize the assay workflow. The results of this assay correlate with the results of previously developed serology and surrogate neutralization assays. The two pseudovirus readout methods produced similar values of 50% neutralization titer values. Harvest-free in situ readouts for live-cell imaging and high-throughput analysis results for flow cytometry can provide unique capabilities for fast evaluation of neutralization, which is critical for the mitigation of future pandemics.

A Sensitive and Controlled Data-Independent Acquisition Method for Proteomic Analysis of Cell Therapies.

Mass spectrometry (MS)-based proteomic measurements are uniquely poised to impact the development of cell and gene therapies. With the adoption of rigorous instrumental performance qualifications (PQs), large-scale proteomics can move from a research to a manufacturing control tool. Especially suited, data-independent acquisition (DIA) approaches have distinctive qualities to extend multiattribute method (MAM) principles to characterize the proteome of cell therapies. Here, we describe the development of a DIA method for the sensitive identification and quantification of proteins on a Q-TOF instrument. Using the improved acquisition parameters, we defined a control strategy and highlighted some metrics to improve the reproducibility of SWATH acquisition-based proteomic measurements. Finally, we applied the method to analyze the proteome of Jurkat cells that here serves as a model for human T-cells. Raw and processed data were deposited in PRIDE (PXD029780).

How measurement science can improve confidence in research results.

The current push for rigor and reproducibility is driven by a desire for confidence in research results. Here, we suggest a framework for a systematic process, based on consensus principles of measurement science, to guide researchers and reviewers in assessing, documenting, and mitigating the sources of uncertainty in a study. All study results have associated ambiguities that are not always clarified by simply establishing reproducibility. By explicitly considering sources of uncertainty, noting aspects of the experimental system that are difficult to characterize quantitatively, and proposing alternative interpretations, the researcher provides information that enhances comparability and reproducibility.

Cause-and-Effect Analysis as a Tool To Improve the Reproducibility of Nanobioassays: Four Case Studies.

One of the challenges in using in vitro data to understand the potential risks of engineered nanomaterials (ENMs) is that results often differ or are even contradictory among studies. While it is recognized that numerous factors can influence results produced by nanobioassays, there has not yet been a consistently used conceptual framework to identify key sources of variability in these assays. In this paper, we use cause-and-effect analysis to systematically describe sources of variability in four key in vitro nanobioassays: the 2',7'-dichlorofluorescein assay, an enzyme-linked immunosorbent assay for measuring interleukin-8, a flow cytometry assay (Annexin V/propidium iodide), and the Comet assay. These assays measure end points that can occur in cells impacted by ENMs through oxidative stress, a principle mechanism for ENM toxicity. The results from this analysis identify control measurements to test for potential artifacts or biases that could occur during conduct of these assays with ENMs. Cause-and-effect analysis also reveals additional measurements that could be performed either in preliminary experiments or each time the assay is run to increase confidence in the assay results and their reproducibility within and among laboratories. The approach applied here with these four assays can be used to support the development of a broad range of nanobioassays.

Summary of the National Institute of Standards and Technology and US Food And Drug Administration cell counting workshop: Sharing practices in cell counting measurements.

The emergence of cell-based therapeutics has increased the need for high-quality, robust and validated measurements for cell characterization. Cell count, being one of the most fundamental measures for cell-based therapeutics, now requires increased levels of measurement confidence. The National Institute of Standards and Technology (NIST) and the US Food and Drug Administration (FDA) jointly hosted a workshop focused on cell counting in April 2017 entitled "NIST-FDA Cell Counting Workshop: Sharing Practices in Cell Counting Measurements." The focus of the workshop was on approaches for selecting, designing and validating cell counting methods and overcoming gaps in obtaining sufficient measurement assurance for cell counting. Key workshop discussion points, representing approximately 50 subject matter experts from industry, academia and government agencies, are summarized here. A key conclusion is the need to design the most appropriate cell counting method, including control/measurement assurance strategies, for a specific counting purposes. There remains a need for documentary standards for streamlining the process to develop, qualify and validate cell counting measurements as well as community-driven efforts to develop new or improved biological and non-biological reference materials.

Agglomeration of Escherichia coli with Positively Charged Nanoparticles Can Lead to Artifacts in a Standard Caenorhabditis elegans Toxicity Assay.

The increased use and incorporation of engineered nanoparticles (ENPs) in consumer products requires a robust assessment of their potential environmental implications. However, a lack of standardized methods for nanotoxicity testing has yielded results that are sometimes contradictory. Standard ecotoxicity assays may work appropriately for some ENPs with minimal modification but produce artifactual results for others. Therefore, understanding the robustness of assays for a range of ENPs is critical. In this study, we evaluated the performance of a standard Caenorhabditis elegans ( C. elegans) toxicity assay containing an Escherichia coli ( E. coli) food supply with silicon, polystyrene, and gold ENPs with different charged coatings and sizes. Of all the ENPs tested, only those with a positively charged coating caused growth inhibition. However, the positively charged ENPs were observed to heteroagglomerate with E. coli cells, suggesting that the ENPs impacted the ability of nematodes to feed, leading to a false positive toxic effect on C. elegans growth and reproduction. When the ENPs were tested in two alternate C. elegans assays that did not contain E. coli, we found greatly reduced toxicity of ENPs. This study illustrates a key unexpected artifact that may occur during nanotoxicity assays.

A novel measure and significance testing in data analysis of cell image segmentation.

BACKGROUND: Cell image segmentation (CIS) is an essential part of quantitative imaging of biological cells. Designing a performance measure and conducting significance testing are critical for evaluating and comparing the CIS algorithms for image-based cell assays in cytometry. Many measures and methods have been proposed and implemented to evaluate segmentation methods. However, computing the standard errors (SE) of the measures and their correlation coefficient is not described, and thus the statistical significance of performance differences between CIS algorithms cannot be assessed. RESULTS: We propose the total error rate (TER), a novel performance measure for segmenting all cells in the supervised evaluation. The TER statistically aggregates all misclassification error rates (MER) by taking cell sizes as weights. The MERs are for segmenting each single cell in the population. The TER is fully supported by the pairwise comparisons of MERs using 106 manually segmented ground-truth cells with different sizes and seven CIS algorithms taken from ImageJ. Further, the SE and 95% confidence interval (CI) of TER are computed based on the SE of MER that is calculated using the bootstrap method. An algorithm for computing the correlation coefficient of TERs between two CIS algorithms is also provided. Hence, the 95% CI error bars can be used to classify CIS algorithms. The SEs of TERs and their correlation coefficient can be employed to conduct the hypothesis testing, while the CIs overlap, to determine the statistical significance of the performance differences between CIS algorithms. CONCLUSIONS: A novel measure TER of CIS is proposed. The TER's SEs and correlation coefficient are computed. Thereafter, CIS algorithms can be evaluated and compared statistically by conducting the significance testing.

Evaluating the quality of a cell counting measurement process via a dilution series experimental design.

BACKGROUND AIMS: Cell counting measurements are critical in the research, development and manufacturing of cell-based products, yet determining cell quantity with accuracy and precision remains a challenge. Validating and evaluating a cell counting measurement process can be difficult because of the lack of appropriate reference material. Here we describe an experimental design and statistical analysis approach to evaluate the quality of a cell counting measurement process in the absence of appropriate reference materials or reference methods. METHODS: The experimental design is based on a dilution series study with replicate samples and observations as well as measurement process controls. The statistical analysis evaluates the precision and proportionality of the cell counting measurement process and can be used to compare the quality of two or more counting methods. As an illustration of this approach, cell counting measurement processes (automated and manual methods) were compared for a human mesenchymal stromal cell (hMSC) preparation. RESULTS: For the hMSC preparation investigated, results indicated that the automated method performed better than the manual counting methods in terms of precision and proportionality. DISCUSSION: By conducting well controlled dilution series experimental designs coupled with appropriate statistical analysis, quantitative indicators of repeatability and proportionality can be calculated to provide an assessment of cell counting measurement quality. This approach does not rely on the use of a reference material or comparison to "gold standard" methods known to have limited assurance of accuracy and precision. The approach presented here may help the selection, optimization, and/or validation of a cell counting measurement process.

Use of Cause-and-Effect Analysis to Design a High-Quality Nanocytotoxicology Assay.

An important consideration in developing standards and regulations that govern the production and use of commercial nanoscale materials is the development of robust and reliable measurements to monitor the potential adverse biological effects of such products. These measurements typically require cell-based and other biological assays that provide an assessment of the risks associated with the nanomaterial of interest. In this perspective, we describe the use of cause-and-effect (C&E) analysis to design robust, high quality cell-based assays to test nanoparticle-related cytotoxicity. C&E analysis of an assay system identifies the sources of variability that influence the test result. These sources can then be used to design control experiments that aid in establishing the validity of a test result. We demonstrate the application of C&E analysis to the commonly used 3-(4,5-dimethylthiazol-2-yl)-5-(3-carboxymethoxyphenyl)-2-(4-sulfophenyl)-2H-tetrazolium (MTS) cell-viability assay. This is the first time to our knowledge that C&E analysis has been used to characterize a cell-based toxicity assay. We propose the use of a 96-well plate layout which incorporates a range of control experiments to assess multiple factors such as nanomaterial interference, pipetting accuracy, cell seeding density, and instrument performance, and demonstrate the performance of the assay using the plate layout in a case study. While the plate layout was formulated specifically for the MTS assay, it is applicable to other cytotoxicity, ecotoxicity (i.e., bacteria toxicity), and nanotoxicity assays after assay-specific modifications.

An automated protocol for performance benchmarking a widefield fluorescence microscope.

Widefield fluorescence microscopy is a highly used tool for visually assessing biological samples and for quantifying cell responses. Despite its widespread use in high content analysis and other imaging applications, few published methods exist for evaluating and benchmarking the analytical performance of a microscope. Easy-to-use benchmarking methods would facilitate the use of fluorescence imaging as a quantitative analytical tool in research applications, and would aid the determination of instrumental method validation for commercial product development applications. We describe and evaluate an automated method to characterize a fluorescence imaging system's performance by benchmarking the detection threshold, saturation, and linear dynamic range to a reference material. The benchmarking procedure is demonstrated using two different materials as the reference material, uranyl-ion-doped glass and Schott 475 GG filter glass. Both are suitable candidate reference materials that are homogeneously fluorescent and highly photostable, and the Schott 475 GG filter glass is currently commercially available. In addition to benchmarking the analytical performance, we also demonstrate that the reference materials provide for accurate day to day intensity calibration. Published 2014 Wiley Periodicals Inc.

Highly stable positively charged dendron-encapsulated gold nanoparticles.

We report the development of a novel cationic dendron (TAG1-PCD) and a positively charged gold nanoparticle-dendron conjugate (PCD-AuNP). TAG1-PCD was designed by considering the reactivity, hydrophilicity, and cationic nature that is required to yield a stable gold conjugate in aqueous media. The PCD-AuNPs, nominally 10 nm in size, were synthesized by reduction of chloroauric acid in the presence of TAG1-PCD. The physicochemical properties of PCD-AuNPs were characterized by dynamic light scattering, transmission electron microscopy, UV-vis absorbance, and X-ray photoelectron spectroscopy for investigation of size distribution, shape uniformity, surface plasmon resonance bands, and Au-dendron bonding. Asymmetric-flow field flow fractionation was employed to confirm the in situ size, purity, and surface properties of the PCD-AuNPs. Additionally, the stability of PCD-AuNPs was systematically evaluated with respect to shelf life determination, stability in biological media and a wide range of pH values, chemical resistance against cyanide, redispersibility from lyophilized state, and stability at temperatures relevant to biological systems. Dose dependent cell viability was evaluated in vitro using the human lung epithelial cell line A549 and a monkey kidney Vero cell line. Observations from in vitro studies are discussed. Overall, the investigation confirmed the successful development of stable PCD-AuNPs with excellent stability in biologically relevant test media containing proteins and electrolytes, and with a shelf life exceeding 6 months. The excellent aqueous stability and apparent lack of toxicity for this conjugate enhances its potential use as a test material for investigating interactions between positively charged NPs and biocellular and biomolecular systems, or as a vehicle for drug delivery.

Technical framework for enabling high quality measurements in new approach methodologies (NAMs).

New approach methodologies (NAMs) are in vitro, in chemico, and in silico or computational approaches that can potentially be used to reduce animal testing. For NAMs that require laboratory experiments, it is critical that they provide consistent and reliable results. While guidance has been provided on improving the reproducibility of NAMs that require laboratory experiments, there is not yet an overarching technical framework that details how to add measurement quality features into a protocol. In this manuscript, we discuss such a framework and provide a step-by-step process describing how to refine a protocol using basic quality tools. The steps in this framework include 1) conceptual analysis of sources of technical variability in the assay, 2) within-laboratory evaluation of assay performance, 3) statistical data analysis, and 4) determination of method transferability (if needed). While each of these steps has discrete components, they are all inter-related, and insights from any step can influence the others. Following the steps in this framework can help reveal the advantages and limitations of different choices during the design of an assay such as which in-process control measurements to include and how many replicates to use for each control measurement and for each test substance. Overall, the use of this technical framework can support optimizing NAM reproducibility, thereby supporting meeting research and regulatory needs.

Development of a 96-Well Electrophilic Allergen Screening Assay for Skin Sensitization Using a Measurement Science Approach.

The Electrophilic Allergen Screening Assay (EASA) has emerged as a promising in chemico method to detect the first key event in the adverse outcome pathway (AOP) for skin sensitization. This assay functions by assessing the depletion of one of two probe molecules (4-nitrobenzenethiol (NBT) and pyridoxylamine (PDA)) in the presence of a test compound (TC). The initial development of EASA utilized a cuvette format resulting in multiple measurement challenges such as low throughput and the inability to include adequate control measurements. In this study, we describe the redesign of EASA into a 96-well plate format that incorporates in-process control measurements to quantify key sources of variability each time the assay is run. The data from the analysis of 67 TCs using the 96-well format had 77% concordance with animal data from the local lymph node assay (LLNA), a result consistent with that for the direct peptide reactivity assay (DPRA), an OECD test guideline (442C) protein binding assay. Overall, the measurement science approach described here provides steps during assay development that can be taken to increase confidence of in chemico assays by attempting to fully characterize the sources of variability and potential biases and incorporate in-process control measurements into the assay.

New concepts for building vocabulary for cell image ontologies.

BACKGROUND: There are significant challenges associated with the building of ontologies for cell biology experiments including the large numbers of terms and their synonyms. These challenges make it difficult to simultaneously query data from multiple experiments or ontologies. If vocabulary terms were consistently used and reused across and within ontologies, queries would be possible through shared terms. One approach to achieving this is to strictly control the terms used in ontologies in the form of a pre-defined schema, but this approach limits the individual researcher's ability to create new terms when needed to describe new experiments. RESULTS: Here, we propose the use of a limited number of highly reusable common root terms, and rules for an experimentalist to locally expand terms by adding more specific terms under more general root terms to form specific new vocabulary hierarchies that can be used to build ontologies. We illustrate the application of the method to build vocabularies and a prototype database for cell images that uses a visual data-tree of terms to facilitate sophisticated queries based on a experimental parameters. We demonstrate how the terminology might be extended by adding new vocabulary terms into the hierarchy of terms in an evolving process. In this approach, image data and metadata are handled separately, so we also describe a robust file-naming scheme to unambiguously identify image and other files associated with each metadata value. The prototype database http://sbd.nist.gov/ consists of more than 2000 images of cells and benchmark materials, and 163 metadata terms that describe experimental details, including many details about cell culture and handling. Image files of interest can be retrieved, and their data can be compared, by choosing one or more relevant metadata values as search terms. Metadata values for any dataset can be compared with corresponding values of another dataset through logical operations. CONCLUSIONS: Organizing metadata for cell imaging experiments under a framework of rules that include highly reused root terms will facilitate the addition of new terms into a vocabulary hierarchy and encourage the reuse of terms. These vocabulary hierarchies can be converted into XML schema or RDF graphs for displaying and querying, but this is not necessary for using it to annotate cell images. Vocabulary data trees from multiple experiments or laboratories can be aligned at the root terms to facilitate query development. This approach of developing vocabularies is compatible with the major advances in database technology and could be used for building the Semantic Web.

Reproducibility and robustness of a real-time microfluidic cell toxicity assay.

Numerous opportunities exist to apply microfluidic technology to high-throughput and high-content cell-based assays. However, maximizing the value of microfluidic assays for applications such as drug discovery, screening, or toxicity evaluation will require assurance of within-device repeatability, day-to-day reproducibility, and robustness to variations in conditions that might occur from laboratory to laboratory. This report describes a study of the performance and variability of a cell-based toxicity assay in microfluidic devices made of poly(dimethylsiloxane) (PDMS). The assay involves expression of destabilized green fluorescent protein (GFP) as a reporter of intracellular protein synthesis and degradation. Reduction in cellular GFP due to inhibition of ribosome activity by cycloheximide (CHX) was quantified with real-time quantitative fluorescence imaging. Assay repeatability was measured within a 64-chamber microfluidic device. Assay performance across a range of cell loading densities within a single device was assessed, as was replication of measurements in microfluidic devices prepared on different days. Assay robustness was tested using different fluorescence illumination sources and reservoir-to-device tubing choices. Both microfluidic and larger scale assay conditions showed comparable GFP decay rates upon CHX exposure, but the microfluidic data provided the higher level of confidence.

Comparison of segmentation algorithms for fluorescence microscopy images of cells.

The analysis of fluorescence microscopy of cells often requires the determination of cell edges. This is typically done using segmentation techniques that separate the cell objects in an image from the surrounding background. This study compares segmentation results from nine different segmentation techniques applied to two different cell lines and five different sets of imaging conditions. Significant variability in the results of segmentation was observed that was due solely to differences in imaging conditions or applications of different algorithms. We quantified and compared the results with a novel bivariate similarity index metric that evaluates the degree of underestimating or overestimating a cell object. The results show that commonly used threshold-based segmentation techniques are less accurate than k-means clustering with multiple clusters. Segmentation accuracy varies with imaging conditions that determine the sharpness of cell edges and with geometric features of a cell. Based on this observation, we propose a method that quantifies cell edge character to provide an estimate of how accurately an algorithm will perform. The results of this study will assist the development of criteria for evaluating interlaboratory comparability.

Cell cycle dependent TN-C promoter activity determined by live cell imaging.

The extracellular matrix protein tenascin-C plays a critical role in development, wound healing, and cancer progression, but how it is controlled and how it exerts its physiological responses remain unclear. By quantifying the behavior of live cells with phase contrast and fluorescence microscopy, the dynamic regulation of TN-C promoter activity is examined. We employ an NIH 3T3 cell line stably transfected with the TN-C promoter ligated to the gene sequence for destabilized green fluorescent protein (GFP). Fully automated image analysis routines, validated by comparison with data derived from manual segmentation and tracking of single cells, are used to quantify changes in the cellular GFP in hundreds of individual cells throughout their cell cycle during live cell imaging experiments lasting 62 h. We find that individual cells vary substantially in their expression patterns over the cell cycle, but that on average TN-C promoter activity increases during the last 40% of the cell cycle. We also find that the increase in promoter activity is proportional to the activity earlier in the cell cycle. This work illustrates the application of live cell microscopy and automated image analysis of a promoter-driven GFP reporter cell line to identify subtle gene regulatory mechanisms that are difficult to uncover using population averaged measurements.

Hybrid cell adhesive material for instant dielectrophoretic cell trapping and long-term cell function assessment.

Dielectrophoresis (DEP) for cell manipulation has focused, for the most part, on approaches for separation/enrichment of cells of interest. Advancements in cell positioning and immobilization onto substrates for cell culture, either as single cells or as cell aggregates, has benefited from the intensified research efforts in DEP (electrokinetic) manipulation. However, there has yet to be a DEP approach that provides the conditions for cell manipulation while promoting cell function processes such as cell differentiation. Here we present the first demonstration of a system that combines DEP with a hybrid cell adhesive material (hCAM) to allow for cell entrapment and cell function, as demonstrated by cell differentiation into neuronlike cells (NLCs). The hCAM, comprised of polyelectrolytes and fibronectin, was engineered to function as an instantaneous cell adhesive surface after DEP manipulation and to support long-term cell function (cell proliferation, induction, and differentiation). Pluripotent P19 mouse embryonal carcinoma cells flowing within a microchannel were attracted to the DEP electrode surface and remained adhered onto the hCAM coating under a fluid flow field after the DEP forces were removed. Cells remained viable after DEP manipulation for up to 8 d, during which time the P19 cells were induced to differentiate into NLCs. This approach could have further applications in areas such as cell-cell communication, three-dimensional cell aggregates to create cell microenvironments, and cell cocultures.

Characteristics to consider when selecting a positive control material for an in vitro assay

The use of in vitro assays to inform decision-making requires robust and reproducible results across studies, laboratories, and time. Experiments using positive control materials are an integral component of an assay procedure to demonstrate the extent to which the measurement system is performing as expected. This paper reviews ten characteristics that should be considered when selecting a positive control material for an in vitro assay: 1) the biological mechanism of action, 2) ease of preparation, 3) chemical purity, 4) verifiable physical properties, 5) stability, 6) ability to generate responses spanning the dynamic range of the assay, 7) technical or biological interference, 8) commercial availability, 9) user toxicity, and 10) disposability. Examples and a case study of the monocyte activation test are provided to demonstrate the application of these characteristics for identification and selection of potential positive control materials. Because specific positive control materials are often written into testing standards for in vitro assays, selection of the positive control material based on these characteristics can aid in ensuring the long-term relevance and usability of these standards.

Cell response to matrix mechanics: focus on collagen.

Many model systems and measurement tools have been engineered for observing and quantifying the effect of mechanics on cellular response. These have contributed greatly to our current knowledge of the molecular events by which mechanical cues affect cell biology. Cell responses to the mechanical properties of type 1 collagen gels are discussed, followed by a description of a model system of very thin, mechanically tunable collagen films that evoke similar responses from cells as do gel systems, but have additional advantages. Cell responses to thin films of collagen suggest that at least some of the mechanical cues that cells can respond to in their environment occur at the sub-micron scale. Mechanical properties of thin films of collagen can be tuned without altering integrin engagement, and in some cases without altering topology, making them useful in addressing questions regarding the roles of specific integrins in transducing or mitigating responses to mechanical cues. The temporal response of cells to differences in ECM may provide insight into mechanisms of signal transduction.