In the realm of artificial intelligence, tackling the intricate challenge of user mistrust is paramount. This scepticism is particularly prominent in the domain of sequential decision-making problems. These AI applications involve intricate sequences of actions, where transparency and tailored solutions are often lacking, leading to user misinterpretations, hesitations, and an overall lack of acceptance. In this context, the EU-funded PEER project aims to reshape the landscape of human-AI collaboration. PEER’s pioneering approach entails placing users at the heart of the AI process, fostering bidirectional communication and mutual learning. Bridging social sciences and AI, PEER crafts new engagement methods, devises AI planning techniques for dynamic scenarios, introduces an AI acceptance index, and tests these concepts.
Project Info
Start 01/10/2020
End 30/09/2024
Funding Horizon Europe (European Commission)
Members Ann Nowé
A significant, highly complex class of artificial intelligence applications are sequential decision-making problems, where a sequence of actions needs to be planned and taken to achieve a desired goal. Examples include routing problems, which involve a sequence of steps from source to destination; the control of manufacturing processes, which consist of a variable sequence of operations; or active learning problems, in which machine learning algorithms query human users for a sequence of inputs.
We address the compelling scientific and technological goal of tackling users’ lack of trust in AI, which currently often hinders the acceptance of AI systems. We break down this problem into two complementary aspects. First, users do not understand current AI systems well, with a lack of transparency leading to misinterpretations and mistrust. Second, current AI systems do not understand users well, offering solutions that are inadequately tailored to the users’ needs and preferences.
PEER will focus on how to systematically put the user at the centre of the entire AI design, development, deployment, and evaluation pipeline, allowing for truly mixed human-AI initiatives on complex sequential decision-making problems. The central idea is to enable a two-way communication flow with enhanced feedback loops between users and AI, leading to improved human-AI collaboration, mutual learning and reasoning, and thus increased user trust and acceptance. As an interdisciplinary project between social sciences and artificial intelligence, PEER will facilitate novel ways of engagement by end-users with AI in the design phase; will create novel AI planning methods for sequential settings which support bidirectional conversation and collaboration between users and AI; will develop an AI acceptance index for the evaluation of AI systems from a human-centric perspective; and will conduct an integration and evaluation of these novel approaches in several real-world use cases.
Coordinator: VRIJE UNIVERSITEIT BRUSSEL
Participants (13)
Peer | The Hyper Expert Collaborative AI Assistant (peer-ai.eu)
