Reproducibility: Buy Low, Sell High

Abstract

Are papers in computer security reproducible? The health of the reproducibility culture in a subfield of security biometrics was assessed in a reproducibility audit of all papers published in the first quarter of 2020. Many papers met some reproducibility criteria, but none met them all. Even in a culture of faster, better, cheaper, reproducibility needn't cost much, but its benefits can be substantial. Buy low, sell high.