Rotation-invariant image recognition using interconnected floating-gate phototransistor

Abstract

Rotational invariance is fundamental for robust image recognition systems, ensuring accurate analysis irrespective of image orientation. However, existing systems predominantly reliant on software often encounter challenges such as increased computational demands and compromises between processing speed and accuracy. In this study, we propose leveraging the interconnected floating-gate (FG) structure as an effective hardware-level solution to achieve rotational invariance in image recognition. Our design features a reconfigurable two-dimensional material FG phototransistor array, where each processing unit integrates four sensory devices sharing a common FG. This configuration facilitates uniform distribution of stored charges across the interconnected FG layer, which is typically made of metal, enabling consistent application of a single weight matrix to images across varied rotational conditions. The photoactive material, tungsten diselenide (WSe2), possesses a distinctive bipolar property that facilitates both hole and electron tunneling into the FG layer. This property directly contributes to the efficiency of state transition within the setup and improves its overall adaptability. In this manner, our design achieves stable and predictable outputs in recognizing identical digital numbers regardless of their rotation, while also demonstrating variable performance essential for accurately distinguishing between different digital numbers. This dual capability guarantees both the adaptability and precision required for rotation-invariant image recognition, suggesting that our work may open up a promising venue for exploring advanced hardware designs, such as optimized interconnected FG architectures, tailored for enhancing recognition accuracy and efficiency in the field of intelligent visual systems.