Explainable AI under contract and tort law: legal incentives and technical challenges

Publication Type:

Journal Article

Source:

Artificial Intelligence and Law, Springer Netherlands, Number 0123456789 (2020)

ISBN:

0123456789

URL:

https://doi.org/10.1007/s10506-020-09260-6

Keywords:

Contract law, Corporate takeovers, Explainability, Explainability-accuracy trade-off, Explainable AI, Interpretable machine learning, Medical malpractice, Tort law

Abstract:

This paper shows that the law, in subtle ways, may set hitherto unrecognized incentives for the adoption of explainable machine learning applications. In doing so, we make two novel contributions. First, on the legal side, we show that to avoid liability, professional actors, such as doctors and managers, may soon be legally compelled to use explainable ML models. We argue that the importance of explainability reaches far beyond data protection law, and crucially influences questions of contractual and tort liability for the use of ML models. To this effect, we conduct two legal case studies, in medical and corporate merger applications of ML. As a second contribution, we discuss the (legally required) trade-off between accuracy and explainability and demonstrate the effect in a technical case study in the context of spam classification.