The University of Southampton
University of Southampton Institutional Repository

Learning to be Competitive in the Market

Learning to be Competitive in the Market
Learning to be Competitive in the Market
Agents that buy and sell goods or services in an electronic market need to adapt to the environment's prevailing conditions if they are able to be successful. Here we propose an on-line, continuous learning mechanism that is especially adapted for agents to learn how to behave when negotiating for resources (goods or services). Taking advantage of the specific characteristics of the price adaptation problem, where the different price states are ordered, we propose a specific reinforcement learning strategy that simultaneously allows good stability and fast convergence. Our method works by positively reinforcing all the lower value states if a particular state is successful and negatively reinforcing all the higher value states when a failure occurs. The resulting adaptive behaviour proved, in several different market situations, to perform better than non-adaptive agents and led to Nash equilibrium when faced with other adaptive opponents.
30-37
Oliveira, E.
68c9f56d-1afe-432d-81d9-3f14a1d76aa4
Fonseca, J. M.
70b3bab2-dad1-4c42-b323-260abdd965e6
Jennings, N. R.
ab3d94cc-247c-4545-9d1e-65873d6cdb30
Oliveira, E.
68c9f56d-1afe-432d-81d9-3f14a1d76aa4
Fonseca, J. M.
70b3bab2-dad1-4c42-b323-260abdd965e6
Jennings, N. R.
ab3d94cc-247c-4545-9d1e-65873d6cdb30

Oliveira, E., Fonseca, J. M. and Jennings, N. R. (1999) Learning to be Competitive in the Market. AAAI Workshop on Negotiation: Settling Conflicts and Identifying Opportunities, Orlando, Florida, United States. pp. 30-37 .

Record type: Conference or Workshop Item (Paper)

Abstract

Agents that buy and sell goods or services in an electronic market need to adapt to the environment's prevailing conditions if they are able to be successful. Here we propose an on-line, continuous learning mechanism that is especially adapted for agents to learn how to behave when negotiating for resources (goods or services). Taking advantage of the specific characteristics of the price adaptation problem, where the different price states are ordered, we propose a specific reinforcement learning strategy that simultaneously allows good stability and fast convergence. Our method works by positively reinforcing all the lower value states if a particular state is successful and negatively reinforcing all the higher value states when a failure occurs. The resulting adaptive behaviour proved, in several different market situations, to perform better than non-adaptive agents and led to Nash equilibrium when faced with other adaptive opponents.

Archive
aaai-ws-eugenio.pdf.gz - Other
Download (112kB)

More information

Published date: 1999
Venue - Dates: AAAI Workshop on Negotiation: Settling Conflicts and Identifying Opportunities, Orlando, Florida, United States, 1999-01-01
Organisations: Agents, Interactions & Complexity

Identifiers

Local EPrints ID: 252171
URI: http://eprints.soton.ac.uk/id/eprint/252171
PURE UUID: 9c2a6f10-4534-4bea-abd1-01ea06172dfc

Catalogue record

Date deposited: 03 Dec 2002
Last modified: 14 Mar 2024 05:17

Export record

Contributors

Author: E. Oliveira
Author: J. M. Fonseca
Author: N. R. Jennings

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×