The University of Southampton
University of Southampton Institutional Repository

Exploration and Exploitation in an Artificial Experimenter

Lovell, Chris, Zauner, Klaus-Peter and Gunn, Steve (2011) Exploration and Exploitation in an Artificial Experimenter At ICML Workshop on On-line Trading of Exploration and Exploitation 2.

Record type: Conference or Workshop Item (Paper)


An artificial experimenter is a computational implementation of the decision making processes a laboratory experimenter will make. Artificial experimenter's analyse the available data, propose hypotheses to represent the behaviours investigated and design experiments to evaluate or improve those hypotheses. In doing so they perform active discovery. A key problem faced is deciding when to perform experiments that exploit the information held within the current hypotheses to evaluate them and when to perform experiments that explore the parameter space to discover features of the behaviour being investigated not yet identified. As resources in physical experimentation are extremely limited, addressing this trade-off is critical to obtaining a representative model of the system under investigation. To achieve this, a Bayesian notion of surprise has been used to effectively manage the transition between exploration and exploitation in simulated and physical experimental trials.

PDF Lovell2011ExploreExploit.pdf - Version of Record
Download (467kB)

More information

Published date: 25 May 2011
Venue - Dates: ICML Workshop on On-line Trading of Exploration and Exploitation 2, 2011-05-25
Organisations: Agents, Interactions & Complexity, Electronic & Software Systems


Local EPrints ID: 272579
PURE UUID: 41005c6a-60df-4c4c-890d-5bb2824167e9

Catalogue record

Date deposited: 18 Jul 2011 12:40
Last modified: 18 Jul 2017 06:22

Export record


Author: Chris Lovell
Author: Klaus-Peter Zauner
Author: Steve Gunn

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.