Optimizing fairness and accuracy: a Pareto optimal approach for decision-making

Abstract

AbstractIn the era of data-driven decision-making, ensuring fairness and equality in machine learning models has become increasingly crucial. Multiple fairness definitions have been brought forward to evaluate and mitigate unintended fairness-related harms in real-world applications, with little research on addressing their interactions with each other. This paper explores the application of a Minimax Pareto-optimized solution to optimize individual and group fairness at individual and group levels on the Adult Census Income dataset as well as on the German Credit dataset. The objective of training a classification model with a multi-objective loss function is to achieve fair outcomes without compromising utility objectives. We investigate the interplay of different fairness definitions, including definitions of performance consistency and traditional group and individual fairness measures, amongst each other coupled with performance. The results presented in this paper highlight the feasibility of incorporating several fairness considerations into machine learning models, which can be applied to use cases with multiple sensitive features and attributes that characterize real-world applications. This research is a valuable step toward building responsible and transparent machine learning systems that can be incorporated into critical decision-making processes.