Abstract

The ability to dynamically learn and adapt to changes in the environment is one of the hallmarks of biological systems. In this work, we identify the subset of the design space of memristive materials that is optimal for dynamic learning applications. Using an architecture inspired on the learning center of the insect brain, we implement a model system consisting of a discrete implementation of spiking neurons where dynamic learning takes place on a set of plastic synapses formed by memristor pairs in a crossbar array. Using two separate benchmarks, one comprising the dynamic learning of the Modified National Institute of Standards and Technology dataset and another one targeting one shot learning, we have identified the key properties that memristive materials should have to be optimal dynamic learners. The results obtained show that a fine degree of control of the memristor internal state is key to achieve high classification accuracy during dynamic learning but that within this optimal region learning is extremely robust both to device variability and to errors in the writing of the internal state, in all cases allowing for 2σ variations greater than 40% without significant loss of accuracy, hence overcoming two of the perceived limitations of memristors. By additionally requiring that learning takes place concurrently to information processing, we are able to derive a set constraints to the memristor dynamics.

Highlights

  • One of the unique aspects of biological systems is their ability to continuously learn and adapt to changes in their environment

  • One comprising the dynamic learning of the Modified National Institute of Standards and Technology dataset and another one targeting one shot learning, we have identified the key properties that memristive materials should have to be optimal dynamic learners

  • As a model system to explore the impact of memristors properties on dynamic learning, we have considered a simple recurrent implementation of spiking neurons that is a discrete analog to the standard leaky integrate and fire (LIF) model

Read more

Summary

INTRODUCTION

One of the unique aspects of biological systems is their ability to continuously learn and adapt to changes in their environment. A key element is the discovery of memristive behavior in different families of materials from amorphous oxides to phase change and chalcogenide materials.4,8–10 In parallel to this fundamental research, a wealth of architectures has been proposed and implemented, many based on the use of crossbar arrays. Using simple architecture inspired on the learning center of the insect brain, we benchmark the memristor’s learning capability against two qualitatively different tasks: the dynamic learning of a supervised discrimination task, in particular, the standard Modified National Institute of Standards and Technology (MNIST) dataset, and a one shot learning scenario We use these tasks to identify the key properties that memristive materials should have to be optimal dynamic learners, and we compare the results with the properties of some of the memristive materials described in the literature. These are two key issues regarding the manufacturability and scale up of architectures based on memristive materials

Neuron model
Memristor model
Architecture
Dynamic learning rule
Memristor constraints for dynamic learning applications
Dynamic learning benchmark
Impact of device variability and write noise
Generalization to other benchmarks
Comparison with experimental devices
DISCUSSION AND CONCLUSIONS
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call