Curiously exploring affordance spaces of a pouring task

Abstract

AbstractHuman beings and other biological agents appear driven by curiosity to explore the affordances of their environments. Such exploration is its own reward – children have fun when playing – but it probably also serves the practical purpose of learning theories with which to predict outcomes of actions. Cognitive robots however have yet to match the performance of human beings at learning and reusing manipulation skills. In this paper, we implement a method that emulates the curiosity drive and uses it as a heuristic to guide (simulated) exploration of a particular task – pouring liquids. The result of this exploration is a collection of symbolic rules linking qualitative descriptions of object arrangements and the pouring action with qualitative descriptions of likely outcomes. The manner in which qualitative descriptions of object arrangements and actions are converted to numerical descriptions for the purpose of simulation parametrization is via probability distributions, which themselves are adjusted in the process of simulated exploration. This allows the grounding of the symbolic descriptions to attempt to adapt itself to the task. The resulting symbolic rules form a theory that, together with the probability distributions that ground it in numerical parametrizations, is intended to be used to predict qualitative outcomes or select manners of pouring towards achieving a goal.