Automation, Alignment, and the Cooperative Interface

Abstract

AbstractThe paper demonstrates that social alignment is distinct from value alignment as it is currently understood in the AI safety literature, and argues that social alignment is an important research agenda. Work provides an important example for the argument, since work is a cooperative endeavor, and it is part of the larger manifold of social cooperation. These cooperative aspects of work are individually and socially valuable, and so they must be given a central place when evaluating the impact of AI upon work. Workplace technologies are not simply instruments for achieving productive goals, but ways of mediating interpersonal relations. They are aspects of a cooperative interface i.e. the infrastructure by which we engage cooperative behavior with others. The concept of the cooperative interface suggests two conjectures to foreground in the social alignment agenda, motivated by the experience of algorithmic trading and social robotics: that AI impacts cooperation through its effects on social networks, and through its effects on social norms.