Predictive optimisation systems do not work, and they infringe rights. So why do we use them?

Abstract

In an increasing number of areas, judgments and decisions that have major effects on people's lives are now being entrusted to Machine Learning systems. The employment of these predictive optimisation systems inevitably leads to unfair, harmful and absurd outcomes: flaws are not occasional and cannot be prevented by technical interventions. Predictive optimisation systems do not work and violate legally protected rights. As Machine Learning is no excuse to break the law, the question is: why do we use such systems?