A novel artificial visual system for motion direction detection in color images

Abstract

In recent years, convolutional neural networks (CNNs) have dominated the field of computer vision. Compared to traditional methods, these neural network algorithms exhibit strong biomimetic performance advantages in complex visual tasks due to their brain-like structure. However, because some necessary neural characteristics are ignored, these neural network algorithms differ greatly from the computational mechanisms of the brain. This paper starts with extracting basic visual features such as motion direction information from the brain and abstracts, generalizes and models a novel artificial visual system (AVS) for detecting object motion direction in color images based on existing relevant neurophysiological knowledge. We propose a mathematical model and quantification mechanism for each component neuron that generates motion direction selectivity in the visual system using dendritic neuron models, spiking neural network concepts and neurophysiological knowledge of retinal direction-selective ganglion cell pathways. The experiment is based on one million instances of object motion under different environments of noise-free, static and dynamic random noise, dynamic salt-and-pepper noise, dynamic Gaussion noise, and dynamic light changing. In comparison with 4 famous CNNs, LeNet-5, EfficientNetB0, ResNet18, and RegNetX-200MF, we test and verify AVS’s effectiveness, efficiency and strong generalization ability as well as other biomimetic performance advantages including high biological rationality, learning-free capability, interpretability and ease-of-use etc. AVS demonstrates that neuroscience still has important implications for guiding and promoting the development of artificial intelligence technology. Furthermore, AVS firstly provides a successful quantitative reference case study for further understanding motion direction selectivity and other primary cortical encoding characteristics in the brain.