A new strategy for bridging the semantic gap in image retrieval

Abstract

Content-based image retrieval (CBIR) research is currently faced with the so called the 'semantic gap' problem. CBIR researchers work at the near end of the gap, applying computer science methods to bridge the gap. Cognitive psychology researchers work at the far end of the gap, studying how humans perceive things in their environment. This article looks at the literature from a new perspective, and presents a structured analysis of what CBIR researchers have done, in their efforts to bridge the gap. This analysis suggests that more emphasis should be placed on studying the far end of the gap. The second part of this article discusses a study conducted at the far end of the gap, to begin the process of developing and testing techniques for externalising and analysing the visual concepts that are evoked by images. This more disciplined approach has the potential to guide researchers in their efforts to bridge the gap.