Special Issue on Autonomous Learning

Abstract

ion of learning processes as observed in neurobiology; quite a few early learning models are based on biological paradigms such as Hebbian learning, i.e. the corresponding algorithms are based on heuristics—the perceptron learning rule for classification or Oja’s rule for dimensionality reduction constitute prominent examples [11]. Albeit these learning rules often reveal a striking simplicity, their mathematical foundation can be quite complicated, even partially unsolved [4, 9]. With time, more and more mathematical formalisms emerged within machine learning which enable researchers to derive a learning rule based on an explicit mathematical modelling of the underlying goal: most modern techniques are accompanied by mathematical cost functions such as the least squares error for regression, constraint margin maximisation for robust classification in support vector machines, or the data log likelihood for model inference [5]. While this mathematical treatment leads to highly efficient learning techniques, it often narrows the applicability of the techniques to specific areas which are covered by the considered cost function and data representation. This way, the machine learning algorithm is uncoupled from the question what is a good cost function and parameterisation of it, what is a good data representation, and what is an informative data set based on which learning becomes possible. These crucial ingredients of machine & Barbara Hammer bhammer@techfak.uni-bielefeld.de Marc Toussaint marc.toussaint@informatik.uni-stuttgart.de 1 CITEC Centre of Excellence, Bielefeld University, 33594 Bielefeld, Germany 2 Machine Learning and Robotics Lab, University of Stuttgart, 70569 Stuttgart, Germany 123 Kunstl Intell (2015) 29:323–327 DOI 10.1007/s13218-015-0392-x