In-sensor reservoir computing based on optoelectronic synaptic devices

Abstract

Artificial neural networks built with optoelectronic synaptic devices have been proven to process visual information effectively. However, it takes great latency time and energy consumption, especially facing dynamic visual information, due to the separated optical sensor, memory, and process unit. Reservoir computing (RC) based on optoelectronic synaptic devices provides an in-sensor RC for processing temporal information efficiently. It achieves efficient computation by sensing and processing optical signals directly with optoelectronic synaptic devices. Optoelectronic synaptic devices shine in visual information processing, whose application in visual sensing and processing will provide a viable hardware solution for in-sensor computing. Therefore, the application of optoelectronic synaptic devices in reservoir computing has prompted increasing attention. Herein, for promoting the application of physical reservoir computing (PRC) with optoelectrical synapses in machine vision, synaptic plasticity will be introduced first in this work and then illustrate the basic functions of optoelectronic synapses as well as their application in reservoir computing further, and provide a perspective on PRC with optoelectronic synapses in the final.