Assessing metasearch engine performance

Abstract

PurposeThe purpose of this paper is to present a new method for evaluating the performance of metasearch engines (MSEs), which was used in the reported study to investigate which of eight popular MSEs (Clusty, Dogpile, Excite, Mamma, MetaCrawler, Search.com, WebCrawler and Webfetch) is the best.Design/methodology/approachThis research evaluated the performance of eight MSEs. For each MSE the average of closeness degrees between its ranked result list and those of its underlying search engines (SEs) was measured. Next, these measures were compared to each other to determine which MSE gives the best performance. Furthermore the experiment was repeated ten times with ten different queries to reach a stable result.FindingsThe findings revealed that Dogpile outperformed all the others, followed by MetaCrawler, Excite, Webfetch and then Mamma. MetaCrawler and WebCrawler had almost the same performance and occupied the next positions. Clusty and Search.com performed poorly in comparison to the others.Practical implicationsThe findings of this research would be useful for MSE designers as well as helping the numerous users of MSEs to choose a truly effective one.Originality/valueThis paper provides a novel method for assessing the performance of MSEs and valuable experimental results on eight popular ones.