Evaluating proposals in innovation contests: Exploring negative scoring spillovers in the absence of a strict evaluation sequence

Abstract

Prior research demonstrated that, when a strict evaluation sequence is present in innovation contests, the score of the previously evaluated proposal negatively influences the scoring of a subsequent proposal. In this paper, we expand our understanding of such negative scoring spillovers by analysing a setting where not only the previously evaluated proposal, but all other proposals within the same meeting can potentially contribute to negative scoring spillovers. We rely on a sample of 561 proposals in 53 publicly funded innovation contests, launched within the scope of four regional innovation programs in the Netherlands. We also introduce an alternative methodological approach with peer effects to adequately model and test the existence of negative scoring spillovers in contests where a strict evaluation sequence is absent. We provide evidence that, in such contests, proposals can mutually influence each other and that the magnitude of these spillovers depends on the design of the innovation contest. We also discuss the implications of these findings for the specific literature on innovation contests and the broader literature on evaluation spillovers in decision-making processes.