The Disciplining Effect of Status: Evaluator Status Awards and Observed Gender Bias in Evaluations

Abstract

We theorize that status awards will have a disciplining effect on evaluators, changing how they evaluate. Specifically, status awards will lead evaluators to place less weight on unreliable indicators of candidate quality, such as gender. We test this theory using data from restaurant evaluations on Yelp, focusing on the relationship between an evaluator’s restaurant rating and their reporting of being served by a man or a woman in their review text. We use Yelp’s evaluator status award (“Elite”) to analyze whether observed gender bias in the star ratings given to restaurants decreases after an evaluator receives this status award. We find that evaluators rate restaurants more similarly after receiving the award, regardless of whether they report being served by a man or a woman. Status awards in our context close the gender gap in restaurant ratings by 56.5% (a 0.07 stars improvement out of an initial rating gap of −0.13 stars). This reduction in gender bias is mostly due to a decrease in the number of extremely low (1 star) ratings in reviews that reference female servers. Research on status and evaluations has mostly focused on how evaluators react to increases in candidate status. We demonstrate the importance of evaluator status as a mechanism for decreasing observed gender differences in evaluations. This paper was accepted by Isabel Fernandez-Mateo, organizations.