Application of an artificial neural network to optimal self-control of an autonomous system in a chaotic environment is described. The system is comprised of a network of sensors, a modeler, a controller, a plant and a utility estimator. The modeler contains a self-organizing radial basis function neural network and a conditional average estimator. A statistical model of influences from the environment, the system response and the utility is formed in the modeler during training. For this purpose the sensors provide signals representing the joint state of the environment and system while the utility estimator transforms these signals into utility descriptor. A vector comprised of the system and environment state variables, the control variable, and the utility is utilized in the self-organized adaptation of reference vectors. During adaptation the samples of control variable are generated randomly or by reinforcement procedure while during application the optimal control variable is estimated by a conditional average over memorized reference vectors. The control variable drives the plant and improves its performance. The method is demonstrated numerically by a self-stabilization of a chaotically kicked system. A perpetual information and control flow in the sensory-neural network of the self-controlled system is interpreted as a kind of machine consciousness.
Read full abstract