Search Engine Evaluation Methodology

Abstract

In this chapter, we explore the various methodologies and statistical measures that have been used for better evaluation of search engines. It also includes a comparative study of statistical and automatic methods and the study of various factors that affect the search engine evaluation process. The chapter presents a broad discussion about the various forums that have been used and provides various data for better evaluation of search engines. Thereafter, the popular statistical measures that have been used to evaluate the search engines are discussed. The chapter also details the automatic approaches of click-through data and eye tracking, and provides the reasons as to why the automatic approach for page quality-related judgments collection is considered superior to traditional approaches.