Back
Optimal Sampling of Parametric Families: Implications for Machine Learning.
Journal article

Optimal Sampling of Parametric Families: Implications for Machine Learning.

  • Huber AEG Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich 8057, Switzerland huberad@ethz.ch.
  • Anumula J Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich 8057, Switzerland jithendar93@outlook.com.
  • Liu SC Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich 8057, Switzerland shih@ini.ethz.ch.
  • 2019-11-09
Published in:
  • Neural computation. - 2020
Arts and Humanities (miscellaneous)
Cognitive Neuroscience
English It is well known in machine learning that models trained on a training set generated by a probability distribution function perform far worse on test sets generated by a different probability distribution function. In the limit, it is feasible that a continuum of probability distribution functions might have generated the observed test set data; a desirable property of a learned model in that case is its ability to describe most of the probability distribution functions from the continuum equally well. This requirement naturally leads to sampling methods from the continuum of probability distribution functions that lead to the construction of optimal training sets. We study the sequential prediction of Ornstein-Uhlenbeck processes that form a parametric family. We find empirically that a simple deep network trained on optimally constructed training sets using the methods described in this letter can be robust to changes in the test set distribution.
Language
  • English
Open access status
closed
Identifiers
Persistent URL
https://sonar.ch/global/documents/38217
Statistics
Document views: 28 File downloads: