Abstract

This paper describes the artificial epigenetic network, a recurrent connectionist architecture that is able to dynamically modify its topology in order to automatically decompose and solve dynamical problems. The approach is motivated by the behavior of gene regulatory networks, particularly the epigenetic process of chromatin remodeling that leads to topological change and which underlies the differentiation of cells within complex biological organisms. We expected this approach to be useful in situations where there is a need to switch between different dynamical behaviors, and do so in a sensitive and robust manner in the absence of a priori information about problem structure. This hypothesis was tested using a series of dynamical control tasks, each requiring solutions that could express different dynamical behaviors at different stages within the task. In each case, the addition of topological self-modification was shown to improve the performance and robustness of controllers. We believe this is due to the ability of topological changes to stabilize attractors, promoting stability within a dynamical regime while allowing rapid switching between different regimes. Post hoc analysis of the controllers also demonstrated how the partitioning of the networks could provide new insights into problem structure.

Highlights

  • C OMPLEX real world tasks can often be reduced to multiple interacting subtasks

  • input set (In) this paper, we investigated the potential benefits of introducing topological self-modification to recurrent neural networks (RNNs) architectures, in the form of an artificial epigenetic network (AEN)

  • The AEN approach was applied to three different dynamical control tasks, using evolutionary algorithms to design the topology and parameters of the networks

Read more

Summary

INTRODUCTION

It has long been realized that there are advantages to capturing the structure of this subtask decomposition within the topology of a neural network architecture, especially when compared with monolithic networks [1]. The brain is not the only naturally occurring connectionist architecture known to solve complex tasks Another prominent biological network, which we consider in this paper, is a cell’s gene regulatory network. We expect the resulting approach to be useful in situations where there is no a priori knowledge of how a task can be decomposed, where there is significant overlap between subtasks, and where highly dynamic solutions are beneficial We demonstrate this by showing that a self-modifying connectionist architecture is able to solve three difficult control.

GENETIC NETWORKS AND CHROMATIN REMODELING
RELATED WORK
Topological Rewriting in Artificial Neural Networks
Self-Modification in Artificial Biochemical Networks
Architecture
Training
Encoding
TASK DEFINITIONS
State-Space Targeting in a Numerical Dynamical System
Balancing a System of Coupled Inverted Pendulums
Controlling Transfer Orbits in a Gravitational System
RESULTS AND ANALYSIS
Coupled Inverted Pendulums
CONCLUSION
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call