Evaluating community science

Abstract

Community science—scientific investigation conducted partly or entirely by non-professional scientists—has many advantages. For example, community science mobilizes large numbers of volunteers who can, at low cost, collect more data than traditional teams of professional scientists. Participation in research can also increase volunteers’ knowledge about and appreciation of science. At the same time, there are worries about the quality of data that community science projects produce. Can the work of non-professionals really deliver trustworthy results? Attempts to answer this question generally compare data collected by volunteers to data collected by professional scientists. When volunteer data is more variable or less accurate than professionally collected data, then the community science project is judged to be inferior to traditional science. I argue that this is not the right standard to use when evaluating community science, because it relies on a false assumption about the aims of science. I show that if we adopt the view that science has diverse aims which are often in tension with one another, then we cannot justify holding community science data to an expert accuracy standard. Instead, we should evaluate the quality of community science data based on its adequacy-for-purpose.