Post-Modern Portfolio Theory for Information Retrieval

Abstract

Information Retrieval (IR) aims to discover relevant information according to a user's information need. The classic Probability Ranking Principle (PRP) forms the theoretical basis for probabilistic IR models. This ranking principle, however, neglects the uncertainty introduced through the estimations from retrieval models. Inspired by the Post-Modern Portfolio Theory (PMPT), this paper proposes a mean-semivariance framework to handle the uncertainty. The proposed framework not only deals with the uncertainty but has the ability to distinguish bad surprises (downside uncertainty) and good surprises (upside uncertainty) when optimizing a ranking list. The experimental results shows that the proposed method improves the IR performance over the PRP baseline in terms of most of IR evaluation metrics; moreover, the results suggest that the mean-semivariance framework can further boost the top-position ranking quality.