Open Access
Algorithmic fairness through group parities? : the case of COMPAS-SAPMOC
Loading...
Files
Algorithmic_fairness_2023.pdf (2.16 MB)
Full-text in Open Access, Published version
License
Attribution 4.0 International
Cadmus Permanent Link
Full-text via DOI
ISBN
ISSN
0951-5666; 1435-5655
Issue Date
Type of Publication
Keyword(s)
LC Subject Heading
Other Topic(s)
EUI Research Cluster(s)
Initial version
Published version
Succeeding version
Preceding version
Published version part
Earlier different version
Initial format
Citation
AI and society, 2023, Vol. 38, pp. 459-478
Cite
LAGIOIA, Francesca, ROVATTI, Riccardo, SARTOR, Giovanni, Algorithmic fairness through group parities? : the case of COMPAS-SAPMOC, AI and society, 2023, Vol. 38, pp. 459-478 - https://hdl.handle.net/1814/76330
Abstract
Machine learning classifiers are increasingly used to inform, or even make, decisions significantly affecting human lives. Fairness concerns have spawned a number of contributions aimed at both identifying and addressing unfairness in algorithmic decision-making. This paper critically discusses the adoption of group-parity criteria (e.g., demographic parity, equality of opportunity, treatment equality) as fairness standards. To this end, we evaluate the use of machine learning methods relative to different steps of the decision-making process: assigning a predictive score, linking a classification to the score, and adopting decisions based on the classification. Throughout our inquiry we use the COMPAS system, complemented by a radical simplification of it (our SAPMOC I and SAPMOC II models), as our running examples. Through these examples, we show how a system that is equally accurate for different groups may fail to comply with group-parity standards, owing to different base rates in the population. We discuss the general properties of the statistics determining the satisfaction of group-parity criteria and levels of accuracy. Using the distinction between scoring, classifying, and deciding, we argue that equalisation of classifications/decisions between groups can be achieved thorough group-dependent thresholding. We discuss contexts in which this approach may be meaningful and useful in pursuing policy objectives. We claim that the implementation of group-parity standards should be left to competent human decision-makers, under appropriate scrutiny, since it involves discretionary value-based political choices. Accordingly, predictive systems should be designed in such a way that relevant policy goals can be transparently implemented. Our paper presents three main contributions: (1) it addresses a complex predictive system through the lens of simplified toy models; (2) it argues for selective policy interventions on the different steps of automated decision-making; (3) it points to the limited significance of statistical notions of fairness to achieve social goals.
Table of Contents
Additional Information
Published online: 28 April 2022
External Links
Publisher
Version
Research Projects
European Commission, 833647
Sponsorship and Funder Information
Francesca Lagioia and Giovanni Sartor have been supported by the H2020 European Research Council (ERC) Project CompuLaw under the European Union’s Horizon 2020 research and innovation programme (Grant Agreement no. 833647) and by the European Union’s Justice Programme (2014-2020) Project ADELE: Analytics for DEcision of LEgal cases (Grant Agreement no. 101007420). Open access funding provided by Alma Mater Studiorum - Università di Bologna within the CRUI-CARE Agreement.