Making exploratory search engines using qualitative case studies: a mixed method implementation using interviews with Detroit Artisans

Abstract

Abstract Search engine algorithms are increasingly subjects of critique, with evidence indicating their role in driving polarization, exclusion, and algorithmic social harms. Many proposed solutions take a top-down approach, with experts proposing bias-corrections. A more participatory approach may be possible, with those made vulnerable by algorithmic unfairness having a voice in how they want to be “found.” By using a mixed methods approach, we sought to develop search engine criteria from the bottom-up. In this project we worked with a group of 16 African American artisanal entrepreneurs in Detroit Michigan, with a majority female and all from low-income communities. Through regular in-depth interviews with select participants, they highlighted their important services, identities and practices. We then used causal set relations with natural language processing to match queries with their qualitative narratives. We refer to this two-step process-- deliberately focusing on social groups with unaddressed needs, and carefully translating narratives to computationally accessible forms--as a “content aware” approach. The resulting content aware search outcomes place themes that participants value, in particular greater relationality, much earlier in the list of results when compared with a standard Web search. More broadly, our use of participatory design with “content awareness” adds evidence to the importance of addressing algorithmic bias by considering who gets to address it; and, that participatory search engine criteria can be modeled as robust linkages between interviews and semantic similarity using causal set relations.