Query Sub-intent Mining by Incorporating Search Results with Query Logs for Information Retrieval

Abstract

Mining query sub-intents or sub-topics is one of the important task in information retrieval. It provides the user several potential queries to explore possible search intents of the user. With the development of Big Data and Natural Language Processing, pre-trained language models have been applied to model complex semantic information of different text resources for mining robust query sub-intents. These studies usually utilize search results and query logs independently as two important resources to generate query sub-intents. However, we deem that the contextual information contained in search results and user interest information contained in query logs can be incorporated together to enhance the effectiveness of user sub-intent mining, which can maximize the best of both resources. To generate high-quality sub-intents, we design a sequence-to-sequence pretrained language model which accepts search result texts and query suggestions extracted from query logs as the input, and outputs generated sub-intent phrases. For modeling the relation between search results and query logs, we design two information encoder and a novel attention mechanism at the decoder part. At each decoding step, the model weights the attention between the input search results and query logs to determine the output token. The experimental results on MIMICS dataset outperform strong baseline methods in almost all evaluation metrics, illustrating the effectiveness of our proposed methods. We also conduct removing studies to prove the effectiveness of search results and query logs individually, and then study and compare different generation paradigms of sub-intent with experiments. We finally show several generated examples to illustrate the quality of our generated sub-intents directly.