Your browser doesn't support javascript.
loading
Benchmark datasets for phylogenomic pipeline validation, applications for foodborne pathogen surveillance.
Timme, Ruth E; Rand, Hugh; Shumway, Martin; Trees, Eija K; Simmons, Mustafa; Agarwala, Richa; Davis, Steven; Tillman, Glenn E; Defibaugh-Chavez, Stephanie; Carleton, Heather A; Klimke, William A; Katz, Lee S.
Affiliation
  • Timme RE; Center for Food Safety and Applied Nutrition, US Food and Drug Administration, College Park, MD, United States of America.
  • Rand H; Center for Food Safety and Applied Nutrition, US Food and Drug Administration, College Park, MD, United States of America.
  • Shumway M; National Center for Biotechnology Information, National Institutes of Health, Bethesda, MD, United States of America.
  • Trees EK; Enteric Diseases Laboratory Branch, Centers for Disease Control and Prevention, Atlanta, GA, United States of America.
  • Simmons M; Food Safety and Inspection Service, US Department of Agriculture, Athens, GA, United States of America.
  • Agarwala R; National Center for Biotechnology Information, National Institutes of Health, Bethesda, MD, United States of America.
  • Davis S; Center for Food Safety and Applied Nutrition, US Food and Drug Administration, College Park, MD, United States of America.
  • Tillman GE; Food Safety and Inspection Service, US Department of Agriculture, Athens, GA, United States of America.
  • Defibaugh-Chavez S; Food Safety and Inspection Service, US Department of Agriculture, Wahington, D.C., United States of America.
  • Carleton HA; Enteric Diseases Laboratory Branch, Centers for Disease Control and Prevention, Atlanta, GA, United States of America.
  • Klimke WA; National Center for Biotechnology Information, National Institutes of Health, Bethesda, MD, United States of America.
  • Katz LS; Enteric Diseases Laboratory Branch, Centers for Disease Control and Prevention, Atlanta, GA, United States of America.
PeerJ ; 5: e3893, 2017.
Article in En | MEDLINE | ID: mdl-29372115
BACKGROUND: As next generation sequence technology has advanced, there have been parallel advances in genome-scale analysis programs for determining evolutionary relationships as proxies for epidemiological relationship in public health. Most new programs skip traditional steps of ortholog determination and multi-gene alignment, instead identifying variants across a set of genomes, then summarizing results in a matrix of single-nucleotide polymorphisms or alleles for standard phylogenetic analysis. However, public health authorities need to document the performance of these methods with appropriate and comprehensive datasets so they can be validated for specific purposes, e.g., outbreak surveillance. Here we propose a set of benchmark datasets to be used for comparison and validation of phylogenomic pipelines. METHODS: We identified four well-documented foodborne pathogen events in which the epidemiology was concordant with routine phylogenomic analyses (reference-based SNP and wgMLST approaches). These are ideal benchmark datasets, as the trees, WGS data, and epidemiological data for each are all in agreement. We have placed these sequence data, sample metadata, and "known" phylogenetic trees in publicly-accessible databases and developed a standard descriptive spreadsheet format describing each dataset. To facilitate easy downloading of these benchmarks, we developed an automated script that uses the standard descriptive spreadsheet format. RESULTS: Our "outbreak" benchmark datasets represent the four major foodborne bacterial pathogens (Listeria monocytogenes, Salmonella enterica, Escherichia coli, and Campylobacter jejuni) and one simulated dataset where the "known tree" can be accurately called the "true tree". The downloading script and associated table files are available on GitHub: https://github.com/WGS-standards-and-analysis/datasets. DISCUSSION: These five benchmark datasets will help standardize comparison of current and future phylogenomic pipelines, and facilitate important cross-institutional collaborations. Our work is part of a global effort to provide collaborative infrastructure for sequence data and analytic tools-we welcome additional benchmark datasets in our recommended format, and, if relevant, we will add these on our GitHub site. Together, these datasets, dataset format, and the underlying GitHub infrastructure present a recommended path for worldwide standardization of phylogenomic pipelines.
Key words

Full text: 1 Collection: 01-internacional Database: MEDLINE Type of study: Screening_studies Language: En Journal: PeerJ Year: 2017 Document type: Article Affiliation country: United States Country of publication: United States

Full text: 1 Collection: 01-internacional Database: MEDLINE Type of study: Screening_studies Language: En Journal: PeerJ Year: 2017 Document type: Article Affiliation country: United States Country of publication: United States