Abstract

This paper presents a bioinspired visual saliency model. The end-stopping mechanism in the primary visual cortex is introduced in to extract features that represent contour information of latent salient objects such as corners, line intersections and line endpoints, which are combined together with brightness, color and orientation features to form the final saliency map. This model is an analog for the processing mechanism of visual signals along from retina, lateral geniculate nucleus(LGN)to primary visual cortex V1:Firstly, according to the characteristics of the retina and LGN, an input image is decomposed into brightness and opposite color channels; Then, the simple cell is simulated with 2D Gabor filters, and the amplitude of Gabor response is utilized to represent the response of complex cell; Finally, the response of an end-stopped cell is obtained by multiplying the response of two complex cells with different orientation, and outputs of V1 and LGN constitute a bottom-up saliency map. Experimental results on public datasets show that our model can accurately predict human fixations, and the performance achieves the state of the art of bottom-up saliency model.

Highlights

  • Object Detection Based on Saliency Map[ J]

  • This paper presents a bioinspired visual saliency model

  • The end⁃stopping mechanism in the primary vis⁃ ual cortex is introduced in to extract features that represent contour information of latent salient objects such as cor⁃ ners, line intersections and line endpoints, which are combined together with brightness, color and orientation fea⁃ tures to form the final saliency map. This model is an analog for the processing mechanism of visual signals along from retina, lateral geniculate nucleus( LGN) to primary visual cortex V1: Firstly, according to the characteristics of the retina and LGN, an input image is decomposed into brightness and opposite color channels; the simple cell is simulated with 2D Gabor filters, and the amplitude of Gabor response is utilized to represent the response of complex cell; the response of an end⁃stopped cell is obtained by multiplying the response of two complex cells with different orientation, and outputs of V1 and LGN constitute a bottom⁃up saliency map

Read more

Summary

Introduction

西北工业大学学报 Journal of Northwestern Polytechnical University https: / / doi.org / 10.1051 / jnwpu / 20193730503 不同于上述模型,本文将 end⁃stopping 机制引入 自底向上显著图的计算框架,通过模拟初级视皮层 V1 中 end⁃stopped 神经元的特性来提取角点、边缘 交叉点和曲率较大点等显著特征,并与颜色、亮度、 方向特征合并,共同形成自底向上显著图的表达。 本文考虑将 end⁃stopping 机制引入自底向上显 著图的计算框架,用于提取角点、边缘交叉点和曲率 较大点等显著特征 ( 本文中统称为 end⁃stopping 特 征) ,将其与方向特征一起作为 V1 显著图表达,并 融合代表侧膝体输出的亮度和颜色特征,合并得到 自底向上显著图,整个流程如图 1 所示。 最新的、性能最优的自底向上模型,eDN 是首个基 于深度学习的显著模型,另外我们还将 end⁃stopping 显著图 ES 加入对比。

Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call