Exploration and Exploitation in an Artificial Experimenter


Lovell, Chris, Zauner, Klaus-Peter and Gunn, Steve (2011) Exploration and Exploitation in an Artificial Experimenter At ICML Workshop on On-line Trading of Exploration and Exploitation 2.

Download

[img] PDF Lovell2011ExploreExploit.pdf - Version of Record
Download (467kB)

Description/Abstract

An artificial experimenter is a computational implementation of the decision making processes a laboratory experimenter will make. Artificial experimenter's analyse the available data, propose hypotheses to represent the behaviours investigated and design experiments to evaluate or improve those hypotheses. In doing so they perform active discovery. A key problem faced is deciding when to perform experiments that exploit the information held within the current hypotheses to evaluate them and when to perform experiments that explore the parameter space to discover features of the behaviour being investigated not yet identified. As resources in physical experimentation are extremely limited, addressing this trade-off is critical to obtaining a representative model of the system under investigation. To achieve this, a Bayesian notion of surprise has been used to effectively manage the transition between exploration and exploitation in simulated and physical experimental trials.

Item Type: Conference or Workshop Item (Paper)
Venue - Dates: ICML Workshop on On-line Trading of Exploration and Exploitation 2, 2011-05-25
Related URLs:
Organisations: Agents, Interactions & Complexity, Electronic & Software Systems
ePrint ID: 272579
Date :
Date Event
25 May 2011Published
Date Deposited: 18 Jul 2011 12:40
Last Modified: 17 Apr 2017 17:42
Further Information:Google Scholar
URI: http://eprints.soton.ac.uk/id/eprint/272579

Actions (login required)

View Item View Item