Efficiently Coevolving Deep Neural Networks and Data Augmentations

Abstract

Designing large deep learning neural networks by hand requires tuning large sets of method parameters, requiring trial and error testing and domain specific knowledge. Neuroevolution methods such as CoDeepNeat (CDN), based on Neuroevolution of Augmenting Topotogies (NEAT), apply evolutionary algorithms to automate deep neural network parameter optimisation. This paper presents and demonstrates various novel beneficial extensions to the CDN method, including new genotypic speciation mechanisms, special mappings in deep neural network encodings, as well as evolving Data Augmentation schemes. Results indicate that these CDN method variants yield significant task-performance benefits over the benchmark CDN method when evaluated on a popular public image recognition data-set.