LOSGSR: Learned Opinion Score Guided Shoeprint Retrieval

Abstract

As a kind of forensic evidence, a shoeprint conveys many important human characteristics, and it plays a vital role in forensic investigations. Millions of shoeprints are acquired from crime scenes, and it is a challenging task to retrieve the most similar shoeprints for a query shoeprint. Most shoeprint retrieval methods sort shoeprint images by feature similarities with respect to the query shoeprint; however, the results are not always what the investigator expects because the retrieval algorithm cannot determine what the investigator prefers based on only the content of the query shoeprint. This paper proposes a method to guide the shoeprint retrieval process to approximate what the user wants by applying learned opinion scores. Additionally, this paper improves shoeprint retrieval effectiveness by implementing the following four perspectives: 1) using the opinion scores of multiple examples to guide the results to meet the forensic experts’ expectations; 2) proposing a learning-based method to refine opinion scores, which corrects the labeled opinion scores of multiple examples and their neighbors; 3) using a manifold ranking method to propagate the opinion scores to other dataset shoeprints; and 4) introducing a coefficient matrix to prevent the tendency of the ranking scores to become low values. The experiments show that the cumulative match scores of the proposed method are more than 96.6% in the top 2% of the dataset composed of 10,096 crime scene shoeprints.