The triad of identity, trust and responsibility in multi-agent systems
The triad of identity, trust and responsibility in multi-agent systems
The design of autonomous AI agents that behave responsibly and foster trust in open multi-agent systems remains a fundamental challenge. Traditional game-theoretical approaches largely assume self-interested behaviour, yet real-world collaborations among humans often rely on prosocial considerations that extend beyond individual utility. To address this, for the first time in this paper, we investigate the triad of identity, responsibility, and trust as core elements shaping responsible multi-agent behaviour. We propose a novel agent model, building on the notion of Computational Transcendence, which equips agents with an elastic sense of identity, enabling them to incorporate the welfare of others into their decision-making. Our framework integrates subjective (identity-based) and objective (experience-based and reputation-based) components of trust. Using Iterated Prisoner’s Dilemma (IPD) simulations on different network structures, we analyse how varying levels of identity and trust affect responsible behaviour. Results demonstrate that the interplay of these three concepts can promote emergent responsibility, mitigate exploitation, and sustain long-term cooperation in dynamic multi-agent environments. We argue that this triadic perspective provides a principled foundation for designing trustworthy, responsible, and identity/value aware agents with implications for future human–AI collaboration.
artificial Intelligence, Multiagent Systems, Identity, Coordination, Responsibility, Trust, Ethics, Norms
Deshmukh, Jayati
5903b0c1-b4d1-4fbf-b687-610d4fde3990
Yazdanpanah, Vahid
28f82058-5e51-4f56-be14-191ab5767d56
Stein, Sebastian
cb2325e7-5e63-475e-8a69-9db2dfbdb00b
Ramchurn, Gopal
1d62ae2a-a498-444e-912d-a6082d3aaea3
Deshmukh, Jayati
5903b0c1-b4d1-4fbf-b687-610d4fde3990
Yazdanpanah, Vahid
28f82058-5e51-4f56-be14-191ab5767d56
Stein, Sebastian
cb2325e7-5e63-475e-8a69-9db2dfbdb00b
Ramchurn, Gopal
1d62ae2a-a498-444e-912d-a6082d3aaea3
Deshmukh, Jayati, Yazdanpanah, Vahid, Stein, Sebastian and Ramchurn, Gopal
(2026)
The triad of identity, trust and responsibility in multi-agent systems.
25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2026), , Paphos, Cyprus.
25 - 29 May 2026.
Record type:
Conference or Workshop Item
(Paper)
Abstract
The design of autonomous AI agents that behave responsibly and foster trust in open multi-agent systems remains a fundamental challenge. Traditional game-theoretical approaches largely assume self-interested behaviour, yet real-world collaborations among humans often rely on prosocial considerations that extend beyond individual utility. To address this, for the first time in this paper, we investigate the triad of identity, responsibility, and trust as core elements shaping responsible multi-agent behaviour. We propose a novel agent model, building on the notion of Computational Transcendence, which equips agents with an elastic sense of identity, enabling them to incorporate the welfare of others into their decision-making. Our framework integrates subjective (identity-based) and objective (experience-based and reputation-based) components of trust. Using Iterated Prisoner’s Dilemma (IPD) simulations on different network structures, we analyse how varying levels of identity and trust affect responsible behaviour. Results demonstrate that the interplay of these three concepts can promote emergent responsibility, mitigate exploitation, and sustain long-term cooperation in dynamic multi-agent environments. We argue that this triadic perspective provides a principled foundation for designing trustworthy, responsible, and identity/value aware agents with implications for future human–AI collaboration.
Text
AAMAS 2026 The Triad of Identity, Trust and Responsibility in Multi-Agent Systems
- Version of Record
More information
e-pub ahead of print date: 25 May 2026
Venue - Dates:
25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2026), , Paphos, Cyprus, 2026-05-25 - 2026-05-29
Keywords:
artificial Intelligence, Multiagent Systems, Identity, Coordination, Responsibility, Trust, Ethics, Norms
Identifiers
Local EPrints ID: 509930
URI: http://eprints.soton.ac.uk/id/eprint/509930
PURE UUID: b22e6fab-5dc1-4782-889f-a06d7ea6cfca
Catalogue record
Date deposited: 11 Mar 2026 17:34
Last modified: 12 Mar 2026 03:10
Export record
Contributors
Author:
Jayati Deshmukh
Author:
Vahid Yazdanpanah
Author:
Sebastian Stein
Author:
Gopal Ramchurn
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics