The University of Southampton
University of Southampton Institutional Repository

Evaluating practical negotiating agents: results and analysis of the 2011 international competition

Baarslag, Tim, Fujita, Katsuhide, Gerding, Enrico H., Hindriks, Koen, Ito, Takayuki, Jennings, Nicholas R., Jonker, Catholijn, Kraus, Sarit, Lin, Raz, Robu, Valentin and Williams, Colin R. (2013) Evaluating practical negotiating agents: results and analysis of the 2011 international competition Artificial Intelligence, 198, pp. 73-103. (doi:10.1016/j.artint.2012.09.004).

Record type: Article


This paper presents an in-depth analysis and key insights gained from the Second International Automated Negotiating Agents Competition (ANAC 2011). ANAC is an international competition that challenges researchers to develop successful automated negotiation agents for scenarios where there is no information about the strategies and preferences of the opponents. The key objectives of this competition are to advance the state-of-the-art in the area of practical bilateral multi-issue negotiations, and to encourage the design of agents that are able to operate effectively across a variety of scenarios. Eighteen teams from seven different institutes competed. This paper describes these agents, the set-up of the tournament, including the negotiation scenarios used, and the results of both the qualifying and final rounds of the tournament. We then go on to analyse the different strategies and techniques employed by the participants using two methods: (i) we classify the agents with respect to their concession behaviour against a set of standard benchmark strategies (ii) we employ empirical game theory (EGT) to investigate the robustness of the strategies. Our analysis of the competition results allows us to highlight several interesting insights for the broader automated negotiation community. In particular, we show that the most adaptive negotiation strategies, while robust across different opponents, were not necessarily the ones to win the competition. Furthermore, our EGT analysis highlights the importance of considering other metrics, besides utility maximisation, in determining what makes a successful and robust negotiation agent in practical settings.

PDF aij-anac2011.pdf - Author's Original
Download (1MB)
PDF 1-s2.0-S0004370212001105-main.pdf - Version of Record
Restricted to Repository staff only
Download (1MB)

More information

Submitted date: 29 November 2011
e-pub ahead of print date: 24 September 2012
Published date: May 2013
Keywords: automated negotiation, bilateral negotiation, AI competitions, multi-agent systems, intelligent agents
Organisations: Agents, Interactions & Complexity


Local EPrints ID: 273036
PURE UUID: d8b2e881-240d-436a-b62f-5b700f05f10c

Catalogue record

Date deposited: 29 Nov 2011 23:14
Last modified: 18 Jul 2017 06:17

Export record



Author: Tim Baarslag
Author: Katsuhide Fujita
Author: Enrico H. Gerding
Author: Koen Hindriks
Author: Takayuki Ito
Author: Nicholas R. Jennings
Author: Catholijn Jonker
Author: Sarit Kraus
Author: Raz Lin
Author: Valentin Robu
Author: Colin R. Williams

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.