ECADEL LABS Research Team
Abstract
# Overview A decision the state cannot explain is a decision the state cannot defend. Explainable AI is often pitched to the public sector as a nice-to-have — a layer of transparency bolted on to improve trust. This brief argues the opposite: in government, the ability to explain a decision is a precondition of the authority to make it at all. The state is not a recommender engine. When it allocates a benefit, flags a fraud risk, or sets a sentence, it exercises coercive power over people who did not opt in. Legitimacy there rests on an old bargain — reasons, a route to contest, and a human who can be held responsible. An unexplainable model breaks all three at once. ## What the full brief covers - **Why the public sector is different** — coercion, due process, and the slide from genuine decision *support* to *delegated authority*. - **The case files** — the Dutch childcare benefits scandal, COMPAS, and Robodebt, and why opacity (not complexity) caused the harm. - **The explanation toolkit** — interpretable-by-design vs. post-hoc methods (SHAP, LIME, counterfactuals), and the faithfulness problem. - **What an explanation is for** — different audiences, automation bias, the attribution gap, and contestability as the real test. - **The legal architecture** — GDPR, the SCHUFA ruling, and the EU AI Act's duties for high-risk public-sector systems. - **Governance scaffolding** — algorithmic impact assessments, transparency registers, audit, and public engagement. - **The emerging-economy frontier** — leapfrogging without re-importing the failures, with relevance to public-interest systems like road safety. - **A builder's & policymaker's playbook** — eight commitments for decision support that survives scrutiny. ## Read the full research The complete brief — including all case studies, the legal analysis, and 28 cited sources — is available as a standalone document. **→ [Read the full research brief](INSERT_LINK_HERE)** --- *Prepared by the ECADEL LABS Research Team. Legal provisions are summarised for orientation, not as legal advice.*
Attached Document
Cite This Work
Cite this work
