Beyond benchmarking and towards predictive models of dataset-specific single-cell RNA-seq pipeline performance.

BACKGROUND: The advent of single-cell RNA-sequencing (scRNA-seq) has driven significant computational methods development for all steps in the scRNA-seq data analysis pipeline, including filtering, normalization, and clustering. The large number of methods and their resulting parameter combinations has created a combinatorial set of possible pipelines to analyze scRNA-seq data, which leads to the obvious question: which is best? Several benchmarking studies compare methods but frequently find variable performance depending on dataset and pipeline characteristics. Alternatively, the large number of scRNA-seq datasets along with advances in supervised machine learning raise a tantalizing possibility: could the optimal pipeline be predicted for a given dataset? RESULTS: Here, we begin to answer this question by applying 288 scRNA-seq analysis pipelines to 86 datasets and quantifying pipeline success via a range of measures evaluating cluster purity and biological plausibility. We build supervised machine learning models to predict pipeline success given a range of dataset and pipeline characteristics. We find that prediction performance is significantly better than random and that in many cases pipelines predicted to perform well provide clustering outputs similar to expert-annotated cell type labels. We identify characteristics of datasets that correlate with strong prediction performance that could guide when such prediction models may be useful. CONCLUSIONS: Supervised machine learning models have utility for recommending analysis pipelines and therefore the potential to alleviate the burden of choosing from the near-infinite number of possibilities. Different aspects of datasets influence the predictive performance of such models which will further guide users.

In vivo CRISPR screens reveal SCAF1 and USP15 as drivers of pancreatic cancer.

Functionally characterizing the genetic alterations that drive pancreatic cancer is a prerequisite for precision medicine. Here, we perform somatic CRISPR/Cas9 mutagenesis screens to assess the transforming potential of 125 recurrently mutated pancreatic cancer genes, which revealed USP15 and SCAF1 as pancreatic tumor suppressors. Mechanistically, we find that USP15 functions in a haploinsufficient manner and that loss of USP15 or SCAF1 leads to reduced inflammatory TNFα, TGF-ß and IL6 responses and increased sensitivity to PARP inhibition and Gemcitabine. Furthermore, we find that loss of SCAF1 leads to the formation of a truncated, inactive USP15 isoform at the expense of full-length USP15, functionally coupling SCAF1 and USP15. Notably, USP15 and SCAF1 alterations are observed in 31% of pancreatic cancer patients. Our results highlight the utility of in vivo CRISPR screens to integrate human cancer genomics and mouse modeling for the discovery of cancer driver genes with potential prognostic and therapeutic implications.

Characterizing the impacts of dataset imbalance on single-cell data integration.

Computational methods for integrating single-cell transcriptomic data from multiple samples and conditions do not generally account for imbalances in the cell types measured in different datasets. In this study, we examined how differences in the cell types present, the number of cells per cell type and the cell type proportions across samples affect downstream analyses after integration. The Iniquitate pipeline assesses the robustness of integration results after perturbing the degree of imbalance between datasets. Benchmarking of five state-of-the-art single-cell RNA sequencing integration techniques in 2,600 integration experiments indicates that sample imbalance has substantial impacts on downstream analyses and the biological interpretation of integration results. Imbalance perturbation led to statistically significant variation in unsupervised clustering, cell type classification, differential expression and marker gene annotation, query-to-reference mapping and trajectory inference. We quantified the impacts of imbalance through newly introduced properties-aggregate cell type support and minimum cell type center distance. To better characterize and mitigate impacts of imbalance, we introduce balanced clustering metrics and imbalanced integration guidelines for integration method users.

The impacts of active and self-supervised learning on efficient annotation of single-cell expression data.

A crucial step in the analysis of single-cell data is annotating cells to cell types and states. While a myriad of approaches has been proposed, manual labeling of cells to create training datasets remains tedious and time-consuming. In the field of machine learning, active and self-supervised learning methods have been proposed to improve the performance of a classifier while reducing both annotation time and label budget. However, the benefits of such strategies for single-cell annotation have yet to be evaluated in realistic settings. Here, we perform a comprehensive benchmarking of active and self-supervised labeling strategies across a range of single-cell technologies and cell type annotation algorithms. We quantify the benefits of active learning and self-supervised strategies in the presence of cell type imbalance and variable similarity. We introduce adaptive reweighting, a heuristic procedure tailored to single-cell data-including a marker-aware version-that shows competitive performance with existing approaches. In addition, we demonstrate that having prior knowledge of cell type markers improves annotation accuracy. Finally, we summarize our findings into a set of recommendations for those implementing cell type annotation procedures or platforms. An R package implementing the heuristic approaches introduced in this work may be found at https://github.com/camlab-bioml/leader .

Radiomics analysis to predict pulmonary nodule malignancy using machine learning approaches.

BACKGROUND: Low-dose CT screening can reduce lung cancer-related mortality. However, most screen-detected pulmonary abnormalities do not develop into cancer and it often remains challenging to identify malignant nodules, particularly among indeterminate nodules. We aimed to develop and assess prediction models based on radiological features to discriminate between benign and malignant pulmonary lesions detected on a baseline screen. METHODS: Using four international lung cancer screening studies, we extracted 2060 radiomic features for each of 16 797 nodules (513 malignant) among 6865 participants. After filtering out low-quality radiomic features, 642 radiomic and 9 epidemiological features remained for model development. We used cross-validation and grid search to assess three machine learning (ML) models (eXtreme Gradient Boosted Trees, random forest, least absolute shrinkage and selection operator (LASSO)) for their ability to accurately predict risk of malignancy for pulmonary nodules. We report model performance based on the area under the curve (AUC) and calibration metrics in the held-out test set. RESULTS: The LASSO model yielded the best predictive performance in cross-validation and was fit in the full training set based on optimised hyperparameters. Our radiomics model had a test-set AUC of 0.93 (95% CI 0.90 to 0.96) and outperformed the established Pan-Canadian Early Detection of Lung Cancer model (AUC 0.87, 95% CI 0.85 to 0.89) for nodule assessment. Our model performed well among both solid (AUC 0.93, 95% CI 0.89 to 0.97) and subsolid nodules (AUC 0.91, 95% CI 0.85 to 0.95). CONCLUSIONS: We developed highly accurate ML models based on radiomic and epidemiological features from four international lung cancer screening studies that may be suitable for assessing indeterminate screen-detected pulmonary nodules for risk of malignancy.

4A after access: a new mnemonic to aid timely administration of IV/IO treatment in trauma patients.

Administration of medication is a well-established part of prehospital trauma care. Guidance varies on the types of recommended medications and when they should be administered. Mnemonics have become commonplace in prehospital medicine to facilitate recall and retention. However, there is no comprehensive aid for the administration of medication in trauma patients. We propose a new mnemonic for the delivery of relevant intravenous or intraosseous medications in trauma patients. A '4A after Access' approach should enhance memory recall for the efficient provision of patient care. These 4As are: antifibrinolysis, analgesia, antiemesis and antibiotics. This mnemonic is designed to be used as an optional aide memoire in conjunction with existing treatment algorithms in the military prehospital setting.

A noncoding single-nucleotide polymorphism at 8q24 drives IDH1-mutant glioma formation.

Establishing causal links between inherited polymorphisms and cancer risk is challenging. Here, we focus on the single-nucleotide polymorphism rs55705857, which confers a sixfold greater risk of isocitrate dehydrogenase (IDH)-mutant low-grade glioma (LGG). We reveal that rs55705857 itself is the causal variant and is associated with molecular pathways that drive LGG. Mechanistically, we show that rs55705857 resides within a brain-specific enhancer, where the risk allele disrupts OCT2/4 binding, allowing increased interaction with the Myc promoter and increased Myc expression. Mutating the orthologous mouse rs55705857 locus accelerated tumor development in an Idh1R132H-driven LGG mouse model from 472 to 172 days and increased penetrance from 30% to 75%. Our work reveals mechanisms of the heritable predisposition to lethal glioma in ~40% of LGG patients.

Loss of apelin blocks the emergence of sprouting angiogenesis in experimental tumors.

Angiogenesis inhibitor drugs targeting vascular endothelial growth factor (VEGF) signaling to the endothelial cell (EC) are used to treat various cancer types. However, primary or secondary resistance to therapy is common. Clinical and pre-clinical studies suggest that alternative pro-angiogenic factors are upregulated after VEGF pathway inhibition. Therefore, identification of alternative pro-angiogenic pathway(s) is critical for the development of more effective anti-angiogenic therapy. Here we study the role of apelin as a pro-angiogenic G-protein-coupled receptor ligand in tumor growth and angiogenesis. We found that loss of apelin in mice delayed the primary tumor growth of Lewis lung carcinoma 1 and B16F10 melanoma when combined with the VEGF receptor tyrosine kinase inhibitor, sunitinib. Targeting apelin in combination with sunitinib markedly reduced the tumor vessel density, and decreased microvessel remodeling. Apelin loss reduced angiogenic sprouting and tip cell marker gene expression in comparison to the sunitinib-alone-treated mice. Single-cell RNA sequencing of tumor EC demonstrated that the loss of apelin prevented EC tip cell differentiation. Thus, apelin is a potent pro-angiogenic cue that supports initiation of tumor neovascularization. Together, our data suggest that targeting apelin may be useful as adjuvant therapy in combination with VEGF signaling inhibition to inhibit the growth of advanced tumors.

The Landscape of COVID-19 Research in the United States: a Cross-sectional Study of Randomized Trials Registered on ClinicalTrials.Gov.

IMPORTANCE: SARS-CoV-2 has infected over 200 million people worldwide, resulting in more than 4 million deaths. Randomized controlled trials are the single best tool to identify effective treatments against this novel pathogen. OBJECTIVE: To describe the characteristics of randomized controlled trials of treatments for COVID-19 in the United States launched in the first 9 months of the pandemic. Design, Setting, and Participants We conducted a cross-sectional study of all completed or actively enrolling randomized, interventional, clinical trials for the treatment of COVID-19 in the United States registered on www.clinicaltrials.gov as of August 10, 2020. We excluded trials of vaccines and other interventions intended to prevent COVID-19. Main Outcomes and Measures We used descriptive statistics to characterize the clinical trials and the statistical power for the available studies. For the late-phase trials (i.e., phase 3 and 2/3 studies), we compared the geographic distribution of the clinical trials with the geographic distribution of people diagnosed with COVID-19. RESULTS: We identified 200 randomized controlled trials of treatments for people with COVID-19. Across all trials, 87 (43.5%) were single-center, 64 (32.0%) were unblinded, and 80 (40.0%) were sponsored by industry. The most common treatments included monoclonal antibodies (N=46 trials), small molecule immunomodulators (N=28), antiviral medications (N=24 trials), and hydroxychloroquine (N=20 trials). Of the 9 trials completed by August 2020, the median sample size was 450 (IQR 67-1113); of the 191 ongoing trials, the median planned sample size was 150 (IQR 60-400). Of the late-phase trials (N=54), the most common primary outcome was a severity scale (N=23, 42.6%), followed by a composite of mortality and ventilation (N=10, 18.5%), and mortality alone (N=6, 11.1%). Among these late-phase trials, all trials of antivirals, monoclonal antibodies, or chloroquine/hydroxychloroquine had a power of less than 25% to detect a 20% relative risk reduction in mortality. Had the individual trials for a given class of treatments instead formed a single trial, the power to detect that same reduction in mortality would have been greater than 98%. There was large variability in access to trials with the highest number of trials per capita in the Northeast and the lowest in the Midwest. CONCLUSIONS AND RELEVANCE: A large number of randomized trials were launched early in the pandemic to evaluate treatments for COVID-19. However, many trials were underpowered for important clinical endpoints and substantial geographic disparities were observed, highlighting the importance of improving national clinical trial infrastructure.

The Basics of Machine Learning.

The Basics of Machine LearningWhen a person is pregnant, a key question is how to establish the "date" of the pregnancy. Classically, the date was based on the last menstrual period (LMP). For the past 3 decades or more, in high-resource countries, this has been done using "hospital-grade" ultrasound machines, with testing performed by trained sonographers. In many parts of the world, neither the machines nor the trained sonographers are accessible. In an article published in NEJM Evidence, Pokaprakarn et al.1 asked whether a low-cost handheld ultrasound device combined with artificial intelligence (AI) could substitute for the expensive machines and trained sonographers.

Automated assignment of cell identity from single-cell multiplexed imaging and proteomic data.

A major challenge in the analysis of highly multiplexed imaging data is the assignment of cells to a priori known cell types. Existing approaches typically solve this by clustering cells followed by manual annotation. However, these often require several subjective choices and cannot explicitly assign cells to an uncharacterized type. To help address these issues we present Astir, a probabilistic model to assign cells to cell types by integrating prior knowledge of marker proteins. Astir uses deep recognition neural networks for fast inference, allowing for annotations at the million-cell scale in the absence of a previously annotated reference. We apply Astir to over 2.4 million cells from suspension and imaging datasets and demonstrate its scalability, robustness to sample composition, and interpretable uncertainty estimates. We envision deployment of Astir either for a first broad cell type assignment or to accurately annotate cells that may serve as biomarkers in multiple disease contexts. A record of this paper's transparent peer review process is included in the supplemental information.

Clonal fitness inferred from time-series modelling of single-cell cancer genomes.

Progress in defining genomic fitness landscapes in cancer, especially those defined by copy number alterations (CNAs), has been impeded by lack of time-series single-cell sampling of polyclonal populations and temporal statistical models1-7. Here we generated 42,000 genomes from multi-year time-series single-cell whole-genome sequencing of breast epithelium and primary triple-negative breast cancer (TNBC) patient-derived xenografts (PDXs), revealing the nature of CNA-defined clonal fitness dynamics induced by TP53 mutation and cisplatin chemotherapy. Using a new Wright-Fisher population genetics model8,9 to infer clonal fitness, we found that TP53 mutation alters the fitness landscape, reproducibly distributing fitness over a larger number of clones associated with distinct CNAs. Furthermore, in TNBC PDX models with mutated TP53, inferred fitness coefficients from CNA-based genotypes accurately forecast experimentally enforced clonal competition dynamics. Drug treatment in three long-term serially passaged TNBC PDXs resulted in cisplatin-resistant clones emerging from low-fitness phylogenetic lineages in the untreated setting. Conversely, high-fitness clones from treatment-naive controls were eradicated, signalling an inversion of the fitness landscape. Finally, upon release of drug, selection pressure dynamics were reversed, indicating a fitness cost of treatment resistance. Together, our findings define clonal fitness linked to both CNA and therapeutic resistance in polyclonal tumours.

Modelling hereditary diffuse gastric cancer initiation using transgenic mouse-derived gastric organoids and single-cell sequencing.

Hereditary diffuse gastric cancer (HDGC) is a cancer syndrome caused by germline variants in CDH1, the gene encoding the cell-cell adhesion molecule E-cadherin. Loss of E-cadherin in cancer is associated with cellular dedifferentiation and poor prognosis, but the mechanisms through which CDH1 loss initiates HDGC are not known. Using single-cell RNA sequencing, we explored the transcriptional landscape of a murine organoid model of HDGC to characterize the impact of CDH1 loss in early tumourigenesis. Progenitor populations of stratified squamous and simple columnar epithelium, characteristic of the mouse stomach, showed lineage-specific transcriptional programs. Cdh1 inactivation resulted in shifts along the squamous differentiation trajectory associated with aberrant expression of genes central to gastrointestinal epithelial differentiation. Cytokeratin 7 (CK7), encoded by the differentiation-dependent gene Krt7, was a specific marker for early neoplastic lesions in CDH1 carriers. Our findings suggest that deregulation of developmental transcriptional programs may precede malignancy in HDGC. © 2021 The Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.

Damage control resuscitation and surgery for indigenous combat casualties: a prospective observational study.

INTRODUCTION: Specialist units that assist indigenous forces (IF) in their strategic aims are supported by medical teams providing point of injury emergency care for casualties, including IF and civilians (Civ). We investigated the activities of a Coalition Forces far-forward medical facility, in order to inform medical providers about the facilities and resources required for medical support to IF and Civ during such operations. METHODS: A prospective observational study (June to August 2017) undertaken at a far-forward Coalition Forces medical support unit (12 rotating personnel) recorded patient details (IF or Civ), mechanism of injury (MOI), number of blood products used, damage control resuscitation (DCR) and damage control surgery (DCS), number of mass casualty (MASCAL) scenarios, resuscitative thoracotomy, resuscitative endovascular balloon occlusion of the aorta (REBOA) and whole blood emergency donor panels (EDP). RESULTS: 680 casualties included 478 IF and 202 Civ (45.5% of the Civ were paediatric). Most common MOIs were blast (n=425; 62.5%) and gunshot wound (n=200; 29.4%). Fifteen (2.2%) casualties died; 627 (92.2%) were transferred to local hospitals. DCR was used for 203 (29.9%), and DCS for 182 (26.8%) casualties. There were 23 MASCAL scenarios, 1220 transfusions and 32 EDPs. REBOA was performed eight times, and thoracotomy was performed 27 times. CONCLUSIONS: A small medical team provided high-tempo emergency resuscitative care for hundreds of IF and Civ casualties within a short space of time using state-of-the-art resuscitative modalities. DCR and DCS were undertaken with a large number of EDPs, and a high survival-to-transfer rate.

Computational modelling in single-cell cancer genomics: methods and future directions.

Single-cell technologies have revolutionized biomedical research by enabling scalable measurement of the genome, transcriptome, proteome, and epigenome of multiple systems at single-cell resolution. Now widely applied to cancer models, these assays offer new insights into tumour heterogeneity, which underlies cancer initiation, progression, and relapse. However, the large quantities of high-dimensional, noisy data produced by single-cell assays can complicate data analysis, obscuring biological signals with technical artifacts. In this review article, we outline the major challenges in analyzing single-cell cancer genomics data and survey the current computational tools available to tackle these. We further outline unsolved problems that we consider major opportunities for future methods development to help interpret the vast quantities of data being generated.

Single cell transcriptomes of normal endometrial derived organoids uncover novel cell type markers and cryptic differentiation of primary tumours.

Endometrial carcinoma, the most common gynaecological cancer, develops from endometrial epithelium which is composed of secretory and ciliated cells. Pathologic classification is unreliable and there is a need for prognostic tools. We used single cell sequencing to study organoid model systems derived from normal endometrial endometrium to discover novel markers specific for endometrial ciliated or secretory cells. A marker of secretory cells (MPST) and several markers of ciliated cells (FAM92B, WDR16, and DYDC2) were validated by immunohistochemistry on organoids and tissue sections. We performed single cell sequencing on endometrial and ovarian tumours and found both secretory-like and ciliated-like tumour cells. We found that ciliated cell markers (DYDC2, CTH, FOXJ1, and p73) and the secretory cell marker MPST were expressed in endometrial tumours and positively correlated with disease-specific and overall survival of endometrial cancer patients. These findings suggest that expression of differentiation markers in tumours correlates with less aggressive disease, as would be expected for tumours that retain differentiation capacity, albeit cryptic in the case of ciliated cells. These markers could be used to improve the risk stratification of endometrial cancer patients, thereby improving their management. We further assessed whether consideration of MPST expression could refine the ProMiSE molecular classification system for endometrial tumours. We found that higher expression levels of MPST could be used to refine stratification of three of the four ProMiSE molecular subgroups, and that any level of MPST expression was able to significantly refine risk stratification of the copy number high subgroup which has the worst prognosis. Taken together, this shows that single cell sequencing of putative cells of origin has the potential to uncover novel biomarkers that could be used to guide management of cancers. © 2020 Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.

Fresh whole blood from walking blood banks for patients with traumatic hemorrhagic shock: A systematic review and meta-analysis.

BACKGROUND: Whole blood is optimal for resuscitation of traumatic hemorrhage. Walking Blood Banks provide fresh whole blood (FWB) where conventional blood components or stored, tested whole blood are not readily available. There is an increasing interest in this as an emergency resilience measure for isolated communities and during crises including the coronavirus disease 2019 pandemic. We conducted a systematic review and meta-analysis of the available evidence to inform practice. METHODS: Standard systematic review methodology was used to obtain studies that reported the delivery of FWB (PROSPERO registry CRD42019153849). Studies that only reported whole blood from conventional blood banking were excluded. For outcomes, odds ratios (ORs) and 95% confidence interval (CI) were calculated using random-effects modeling because of high risk of heterogeneity. Quality of evidence was assessed using the Grading of Recommendations, Assessment, Development, and Evaluation system. RESULTS: Twenty-seven studies published from 2006 to 2020 reported >10,000 U of FWB for >3,000 patients (precise values not available for all studies). Evidence for studies was "low" or "very low" except for one study, which was "moderate" in quality. Fresh whole blood patients were more severely injured than non-FWB patients. Overall, survival was equivalent between FWB and non-FWB groups for eight studies that compared these (OR, 1.00 [95% CI, 0.65-1.55]; p = 0.61). However, the highest quality study (matched groups for physiological and injury characteristics) reported an adjusted OR of 0.27 (95% CI, 0.13-0.58) for mortality for the FWB group (p < 0.01). CONCLUSION: Thousands of units of FWB from Walking Blood Banks have been transfused in patients following life-threatening hemorrhage. Survival is equivalent for FWB resuscitation when compared with non-FWB, even when patients were more severely injured. Evidence is scarce and of relative low quality and may underestimate potential adverse events. Whereas Walking Blood Banks may be an attractive resilience measure, caution is still advised. Walking Blood Banks should be subject to prospective evaluation to optimize care and inform policy. LEVEL OF EVIDENCE: Systematic/therapeutic, level 3.

Eleven grand challenges in single-cell data science.

The recent boom in microfluidics and combinatorial indexing strategies, combined with low sequencing costs, has empowered single-cell sequencing technology. Thousands-or even millions-of cells analyzed in a single experiment amount to a data revolution in single-cell biology and pose unique data science problems. Here, we outline eleven challenges that will be central to bringing this emerging field of single-cell data science forward. For each challenge, we highlight motivating research questions, review prior work, and formulate open problems. This compendium is for established researchers, newcomers, and students alike, highlighting interesting and rewarding problems for the coming years.

Dissociation of solid tumor tissues with cold active protease for single-cell RNA-seq minimizes conserved collagenase-associated stress responses.

BACKGROUND: Single-cell RNA sequencing (scRNA-seq) is a powerful tool for studying complex biological systems, such as tumor heterogeneity and tissue microenvironments. However, the sources of technical and biological variation in primary solid tumor tissues and patient-derived mouse xenografts for scRNA-seq are not well understood. RESULTS: We use low temperature (6 °C) protease and collagenase (37 °C) to identify the transcriptional signatures associated with tissue dissociation across a diverse scRNA-seq dataset comprising 155,165 cells from patient cancer tissues, patient-derived breast cancer xenografts, and cancer cell lines. We observe substantial variation in standard quality control metrics of cell viability across conditions and tissues. From the contrast between tissue protease dissociation at 37 °C or 6 °C, we observe that collagenase digestion results in a stress response. We derive a core gene set of 512 heat shock and stress response genes, including FOS and JUN, induced by collagenase (37 °C), which are minimized by dissociation with a cold active protease (6 °C). While induction of these genes was highly conserved across all cell types, cell type-specific responses to collagenase digestion were observed in patient tissues. CONCLUSIONS: The method and conditions of tumor dissociation influence cell yield and transcriptome state and are both tissue- and cell-type dependent. Interpretation of stress pathway expression differences in cancer single-cell studies, including components of surface immune recognition such as MHC class I, may be especially confounded. We define a core set of 512 genes that can assist with the identification of such effects in dissociated scRNA-seq experiments.