Contestable Artificial Intelligence: Constructive design research for public artificial intelligence systems that are open and responsive to dispute.
This thesis investigates the use of artificial intelligence (AI) in public policy execution. To contribute to preserving citizen autonomy, it introduces the concept of ‘contestability’—a system quality that ensures citizens retain control over their lives in the face of AI systems and can influence AI system development. The central research aim is to explore sociotechnical design interventions that enhance the contestability of public AI systems.
Utilizing constructive design research, the thesis reports on several studies in which researchers collaborate with design practitioners to create artifacts that function as data generation instruments. Methods encompass interaction design, speculative design, and information design, with case studies in smart electric vehicle charging, urban monitoring camera cars, and fraud risk models, all situated in Amsterdam.
Key findings include varying perceptions of AI transparency between citizens and experts, a design framework for contestable AI, challenges in local government implementation, and the metaphors designers use for public AI.
The research advocates for integrating citizen feedback into AI systems, promoting dialogue between citizens and system controllers, and enhancing democratic involvement in AI development. It also highlights the importance of design in AI implementation, emphasizing speculative design as a method for generating relevant data and guiding ideation and specification processes.
Concluding, the thesis calls for a greater engagement of design researchers and practitioners with political philosophy to understand the democratic implications of their work in AI and related fields.
Defense:
On May 23, 2024 at 15:00, Christiaan Pieter (Kars) Alfrink defended his PhD dissertation “Contestable Artificial Intelligence: Constructive design research for public artificial intelligence systems that are open and responsive to dispute” at Delft University of Technology. The research was supervised by Prof.dr. Gerd Kortuem and Prof.dr.mr.ir. Neelke Doorn (promotors) and Dr.ir. Ianus Keller (copromotor). The doctoral committee included Prof.dr. Liesbet van Zoonen (Erasmus University Rotterdam), Prof.dr. Jonas Löwgren (Linköping University), Prof.dr. Virginia Dignum (Umeå University), Prof.dr.ir. Ibo van de Poel (Delft University of Technology), and Prof.dr. Pieter Jan Stappers (Delft University of Technology) as reserve member. The research was supported by the Dutch National Research Council NWO and the dissertation is freely available under a Creative Commons Attribution 4.0 International license (DOI: 10/mgtv).
Citation:
Alfrink, K. (2024). Contestable Artificial Intelligence: Constructive design research for public artificial intelligence systems that are open and responsive to dispute [Delft University of Technology]. https://doi.org/mgtv