Journal article

A Random Categorization Model for Hierarchical Taxonomies.

  • D'Amico G Theoretical Physics Department, CERN, Geneva, Switzerland.
  • Rabadan R Departments of Systems Biology and Biomedical Informatics, Columbia University, New York, USA.
  • Kleban M Center for Cosmology and Particle Physics, Physics Department, New York University, New York, USA. kleban@nyu.edu.
  • 2017-12-08
Published in:
  • Scientific reports. - 2017
English A taxonomy is a standardized framework to classify and organize items into categories. Hierarchical taxonomies are ubiquitous, ranging from the classification of organisms to the file system on a computer. Characterizing the typical distribution of items within taxonomic categories is an important question with applications in many disciplines. Ecologists have long sought to account for the patterns observed in species-abundance distributions (the number of individuals per species found in some sample), and computer scientists study the distribution of files per directory. Is there a universal statistical distribution describing how many items are typically found in each category in large taxonomies? Here, we analyze a wide array of large, real-world datasets - including items lost and found on the New York City transit system, library books, and a bacterial microbiome - and discover such an underlying commonality. A simple, non-parametric branching model that randomly categorizes items and takes as input only the total number of items and the total number of categories is quite successful in reproducing the observed abundance distributions. This result may shed light on patterns in species-abundance distributions long observed in ecology. The model also predicts the number of taxonomic categories that remain unrepresented in a finite sample.
Language
  • English
Open access status
gold
Identifiers
Persistent URL
https://sonar.ch/global/documents/180954
Statistics

Document views: 29 File downloads:
  • Full-text: 0