Journal article

Critical Assessment of Metagenome Interpretation-a benchmark of metagenomics software.

  • Sczyrba A Faculty of Technology, Bielefeld University, Bielefeld, Germany.
  • Hofmann P Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
  • Belmann P Faculty of Technology, Bielefeld University, Bielefeld, Germany.
  • Koslicki D Mathematics Department, Oregon State University, Corvallis, Oregon, USA.
  • Janssen S Department of Computational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), Braunschweig, Germany.
  • Dröge J Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
  • Gregor I Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
  • Majda S Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
  • Fiedler J Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
  • Dahms E Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
  • Bremges A Faculty of Technology, Bielefeld University, Bielefeld, Germany.
  • Fritz A Department of Computational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), Braunschweig, Germany.
  • Garrido-Oter R Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
  • Jørgensen TS Department of Environmental Science, Section of Environmental microbiology and Biotechnology, Aarhus University, Roskilde, Denmark.
  • Shapiro N Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Blood PD Pittsburgh Supercomputing Center, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA.
  • Gurevich A Center for Algorithmic Biotechnology, Institute of Translational Biomedicine, Saint Petersburg State University, Saint Petersburg, Russia.
  • Bai Y Department of Plant Microbe Interactions, Max Planck Institute for Plant Breeding Research, Cologne, Germany.
  • Turaev D Department of Microbiology and Ecosystem Science, University of Vienna, Vienna, Austria.
  • DeMaere MZ The ithree institute, University of Technology Sydney, Sydney, New South Wales, Australia.
  • Chikhi R Department of Computer Science, Research Center in Computer Science (CRIStAL), Signal and Automatic Control of Lille, Lille, France.
  • Nagarajan N Department of Computational and Systems Biology, Genome Institute of Singapore, Singapore.
  • Quince C Department of Microbiology and Infection, Warwick Medical School, University of Warwick, Coventry, UK.
  • Meyer F Department of Computational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), Braunschweig, Germany.
  • Balvočiūtė M Department of Computer Science, University of Tuebingen, Tuebingen, Germany.
  • Hansen LH Department of Environmental Science, Section of Environmental microbiology and Biotechnology, Aarhus University, Roskilde, Denmark.
  • Sørensen SJ Department of Microbiology, University of Copenhagen, Copenhagen, Denmark.
  • Chia BKH Department of Computational and Systems Biology, Genome Institute of Singapore, Singapore.
  • Denis B Department of Computational and Systems Biology, Genome Institute of Singapore, Singapore.
  • Froula JL Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Wang Z Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Egan R Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Don Kang D Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Cook JJ Intel Corporation, Hillsboro, Oregon, USA.
  • Deltel C GenScale-Bioinformatics Research Team, Inria Rennes-Bretagne Atlantique Research Centre, Rennes, France.
  • Beckstette M Department of Molecular Infection Biology, Helmholtz Centre for Infection Research, Braunschweig, Germany.
  • Lemaitre C GenScale-Bioinformatics Research Team, Inria Rennes-Bretagne Atlantique Research Centre, Rennes, France.
  • Peterlongo P GenScale-Bioinformatics Research Team, Inria Rennes-Bretagne Atlantique Research Centre, Rennes, France.
  • Rizk G Institute of Research in Informatics and Random Systems (IRISA), Rennes, France.
  • Lavenier D National Centre of the Scientific Research (CNRS), Rennes, France.
  • Wu YW Joint BioEnergy Institute, Emeryville, California, USA.
  • Singer SW Joint BioEnergy Institute, Emeryville, California, USA.
  • Jain C School of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, Georgia, USA.
  • Strous M Energy Engineering and Geomicrobiology, University of Calgary, Calgary, Alberta, Canada.
  • Klingenberg H Department of Bioinformatics, Institute for Microbiology and Genetics, University of Goettingen, Goettingen, Germany.
  • Meinicke P Department of Bioinformatics, Institute for Microbiology and Genetics, University of Goettingen, Goettingen, Germany.
  • Barton MD Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Lingner T Genevention GmbH, Goettingen, Germany.
  • Lin HH Institute of Population Health Sciences, National Health Research Institutes, Zhunan Town, Taiwan.
  • Liao YC Institute of Population Health Sciences, National Health Research Institutes, Zhunan Town, Taiwan.
  • Silva GGZ Computational Science Research Center, San Diego State University, San Diego, California, USA.
  • Cuevas DA Computational Science Research Center, San Diego State University, San Diego, California, USA.
  • Edwards RA Computational Science Research Center, San Diego State University, San Diego, California, USA.
  • Saha S Boyce Thompson Institute for Plant Research, New York, New York, USA.
  • Piro VC Research Group Bioinformatics (NG4), Robert Koch Institute, Berlin, Germany.
  • Renard BY Research Group Bioinformatics (NG4), Robert Koch Institute, Berlin, Germany.
  • Pop M Center for Bioinformatics and Computational Biology, University of Maryland, College Park, Maryland, USA.
  • Klenk HP School of Biology, Newcastle University, Newcastle upon Tyne, UK.
  • Göker M Leibniz Institute DSMZ-German Collection of Microorganisms and Cell Cultures, Braunschweig, Germany.
  • Kyrpides NC Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Woyke T Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Vorholt JA Institute of Microbiology, ETH Zurich, Zurich, Switzerland.
  • Schulze-Lefert P Department of Plant Microbe Interactions, Max Planck Institute for Plant Breeding Research, Cologne, Germany.
  • Rubin EM Department of Energy, Joint Genome Institute, Walnut Creek, California, USA.
  • Darling AE The ithree institute, University of Technology Sydney, Sydney, New South Wales, Australia.
  • Rattei T Department of Microbiology and Ecosystem Science, University of Vienna, Vienna, Austria.
  • McHardy AC Formerly Department of Algorithmic Bioinformatics, Heinrich Heine University (HHU), Duesseldorf, Germany.
Show more…
  • 2017-10-03
Published in:
  • Nature methods. - 2017
English Methods for assembly, taxonomic profiling and binning are key to interpreting metagenome data, but a lack of consensus about benchmarking complicates performance assessment. The Critical Assessment of Metagenome Interpretation (CAMI) challenge has engaged the global developer community to benchmark their programs on highly complex and realistic data sets, generated from ∼700 newly sequenced microorganisms and ∼600 novel viruses and plasmids and representing common experimental setups. Assembly and genome binning programs performed well for species represented by individual genomes but were substantially affected by the presence of related strains. Taxonomic profiling and binning programs were proficient at high taxonomic ranks, with a notable performance decrease below family level. Parameter settings markedly affected performance, underscoring their importance for program reproducibility. The CAMI results highlight current challenges but also provide a roadmap for software selection to answer specific research questions.
Language
  • English
Open access status
hybrid
Identifiers
Persistent URL
https://sonar.ch/global/documents/52225
Statistics

Document views: 62 File downloads:
  • Full-text: 0