Answering machines: how to (epistemically) evaluate a search engine

Abstract

ABSTRACT We commonly evaluate search engines and the results they return, but what grounds those evaluations? One straightforward way of evaluating search engines appeals to their ability to satisfy the goals of the user. Are there, in addition, user-independent norms, that allow us to evaluate search engines in ways that may come apart from their ability to satisfy the individuals who use them? One way of grounding such norms appeals to moral or political considerations. I argue that in addition to those norms, there are also distinct user-independent epistemic norms that apply to search engines. Evaluating search engines relative to them, however, requires us to appreciate the impact search engines have on our practices and norms of inquiry more broadly: by systematically altering the accessibility of information, search engines don’t just give us information but shape our collective imagination, and the categories it operates over.