ABSTRACT
Spatial transcriptomics (ST) technologies allow the profiling of the transcriptome of cells while keeping their spatial context. Since most commercial untargeted ST technologies do not yet operate at single-cell resolution, computational methods such as deconvolution are often used to infer the cell type composition of each sequenced spot. We benchmarked 11 deconvolution methods using 63 silver standards, 3 gold standards, and 2 case studies on liver and melanoma tissues. We developed a simulation engine called synthspot to generate silver standards from single-cell RNA-sequencing data, while gold standards are generated by pooling single cells from targeted ST data. We evaluated methods based on their performance, stability across different reference datasets, and scalability. We found that cell2location and RCTD are the top-performing methods, but surprisingly, a simple regression model outperforms almost half of the dedicated spatial deconvolution methods. Furthermore, we observe that the performance of all methods significantly decreased in datasets with highly abundant or rare cell types. Our results are reproducible in a Nextflow pipeline, which also allows users to generate synthetic data, run deconvolution methods and optionally benchmark them on their dataset (https://github.com/saeyslab/spotless-benchmark).
Subject(s)
Benchmarking , Gene Expression Profiling , Transcriptome , Humans , Gene Expression Profiling/methods , Single-Cell Analysis/methods , Software , Computational Biology/methods , Sequence Analysis, RNA/methods , Melanoma/genetics , Reproducibility of Results , LiverABSTRACT
With the growing number of single-cell analysis tools, benchmarks are increasingly important to guide analysis and method development. However, a lack of standardisation and extensibility in current benchmarks limits their usability, longevity, and relevance to the community. We present Open Problems, a living, extensible, community-guided benchmarking platform including 10 current single-cell tasks that we envision will raise standards for the selection, evaluation, and development of methods in single-cell analysis.
ABSTRACT
MOTIVATION: We describe a new Python implementation of FlowSOM, a clustering method for cytometry data. RESULTS: This implementation is faster than the original version in R, better adapted to work with single-cell omics data including integration with current single-cell data structures and includes all the original visualizations, such as the star and pie plot. AVAILABILITY AND IMPLEMENTATION: The FlowSOM Python implementation is freely available on GitHub: https://github.com/saeyslab/FlowSOM_Python.
Subject(s)
Flow Cytometry , Single-Cell Analysis , Software , Single-Cell Analysis/methods , Flow Cytometry/methods , Cluster Analysis , Computational Biology/methods , Algorithms , HumansABSTRACT
MOTIVATION: Automatic cell type annotation methods assign cell type labels to new datasets by extracting relationships from a reference RNA-seq dataset. However, due to the limited resolution of gene expression features, there is always uncertainty present in the label assignment. To enhance the reliability and robustness of annotation, most machine learning methods address this uncertainty by providing a full reject option, i.e. when the predicted confidence score of a cell type label falls below a user-defined threshold, no label is assigned and no prediction is made. As a better alternative, some methods deploy hierarchical models and consider a so-called partial rejection by returning internal nodes of the hierarchy as label assignment. However, because a detailed experimental analysis of various rejection approaches is missing in the literature, there is currently no consensus on best practices. RESULTS: We evaluate three annotation approaches (i) full rejection, (ii) partial rejection, and (iii) no rejection for both flat and hierarchical probabilistic classifiers. Our findings indicate that hierarchical classifiers are superior when rejection is applied, with partial rejection being the preferred rejection approach, as it preserves a significant amount of label information. For optimal rejection implementation, the rejection threshold should be determined through careful examination of a method's rejection behavior. Without rejection, flat and hierarchical annotation perform equally well, as long as the cell type hierarchy accurately captures transcriptomic relationships. AVAILABILITY AND IMPLEMENTATION: Code is freely available at https://github.com/Latheuni/Hierarchical_reject and https://doi.org/10.5281/zenodo.10697468.
Subject(s)
Gene Expression Profiling , Transcriptome , Reproducibility of Results , Uncertainty , Machine Learning , Single-Cell Analysis , Sequence Analysis, RNAABSTRACT
Spatially resolved omics technologies are transforming our understanding of biological tissues. However, the handling of uni- and multimodal spatial omics datasets remains a challenge owing to large data volumes, heterogeneity of data types and the lack of flexible, spatially aware data structures. Here we introduce SpatialData, a framework that establishes a unified and extensible multiplatform file-format, lazy representation of larger-than-memory data, transformations and alignment to common coordinate systems. SpatialData facilitates spatial annotations and cross-modal aggregation and analysis, the utility of which is illustrated in the context of multiple vignettes, including integrative analysis on a multimodal Xenium and Visium breast cancer study.
ABSTRACT
Myelodysplastic neoplasms (MDS) encompass haematological malignancies, which are characterised by dysplasia, ineffective haematopoiesis and the risk of progression towards acute myeloid leukaemia (AML). Myelodysplastic neoplasms are notorious for their heterogeneity: clinical outcomes range from a near-normal life expectancy to leukaemic transformation or premature death due to cytopenia. The Molecular International Prognostic Scoring System made progress in the dissection of MDS by clinical outcomes. To contribute to the risk stratification of MDS by immunophenotypic profiles, this study performed computational clustering of flow cytometry data of CD34+ cells in 67 MDS, 67 AML patients and 49 controls. Our data revealed heterogeneity also within the MDS-derived CD34+ compartment. In MDS, maintenance of lymphoid progenitors and megakaryocytic-erythroid progenitors predicted favourable outcomes, whereas expansion of granulocyte-monocyte progenitors increased the risk of leukaemic transformation. The proliferation of haematopoietic stem cells and common myeloid progenitors with downregulated CD44 expression, suggestive of impaired haematopoietic differentiation, characterised a distinct MDS subtype with a poor overall survival. This exploratory study demonstrates the prognostic value of known and previously unexplored CD34+ populations and suggests the feasibility of dissecting MDS into a more indolent, a leukaemic and another unfavourable subtype.
Subject(s)
Hematopoietic Stem Cells , Myelodysplastic Syndromes , Humans , Myelodysplastic Syndromes/pathology , Hematopoietic Stem Cells/pathology , Hematopoietic Stem Cells/metabolism , Aged , Middle Aged , Male , Female , Prognosis , Adult , Aged, 80 and over , Antigens, CD34/metabolism , Leukemia, Myeloid, Acute/pathology , Immunophenotyping , Cluster Analysis , Flow Cytometry/methods , Case-Control StudiesABSTRACT
To better understand intrinsic resistance to immune checkpoint blockade (ICB), we established a comprehensive view of the cellular architecture of the treatment-naive melanoma ecosystem and studied its evolution under ICB. Using single-cell, spatial multi-omics, we showed that the tumor microenvironment promotes the emergence of a complex melanoma transcriptomic landscape. Melanoma cells harboring a mesenchymal-like (MES) state, a population known to confer resistance to targeted therapy, were significantly enriched in early on-treatment biopsies from non-responders to ICB. TCF4 serves as the hub of this landscape by being a master regulator of the MES signature and a suppressor of the melanocytic and antigen presentation transcriptional programs. Targeting TCF4 genetically or pharmacologically, using a bromodomain inhibitor, increased immunogenicity and sensitivity of MES cells to ICB and targeted therapy. We thereby uncovered a TCF4-dependent regulatory network that orchestrates multiple transcriptional programs and contributes to resistance to both targeted therapy and ICB in melanoma.