Integrating Image Perception and Time‐to‐First‐Spike Coding in MoS2 Phototransistors for Spiking Neural Network

Abstract

AbstractHuman vision system remains alert for dangers and adopts high‐speed and low‐power coding methods to convert the image information to spike signals. To meet the demand for danger alert in machine vision, it is important to design intelligent sensors to integrate the functions of image perception and high‐efficiency coding for high‐priority analysis. Inspired by the human visual system, a MoS2 phototransistor is introduced on SiNx substrate enabling simultaneous image perception and time‐to‐first‐spike (TTFS) coding. The device demonstrates exceptional performance in encoding 3‐bit grayscale images, achieving a low mean squared error of 0.008 and a high structural similarity index of 0.9784. Spiking neural networks (SNN) with TTFS coding achieve high recognition accuracy (98.86%) while reducing spike count by 75%. The device array also perceives motion direction and object states by converting data temporally. This work establishes a hardware foundation to promote the performance of SNNs in efficiently identifying crucial information.