Exploration and Exploitation in an Artificial Experimenter


Lovell, Chris, Zauner, Klaus-Peter and Gunn, Steve (2011) Exploration and Exploitation in an Artificial Experimenter. In, ICML Workshop on On-line Trading of Exploration and Exploitation 2

Download

[img] PDF - Published Version
Download (456Kb)

Description/Abstract

An artificial experimenter is a computational implementation of the decision making processes a laboratory experimenter will make. Artificial experimenter's analyse the available data, propose hypotheses to represent the behaviours investigated and design experiments to evaluate or improve those hypotheses. In doing so they perform active discovery. A key problem faced is deciding when to perform experiments that exploit the information held within the current hypotheses to evaluate them and when to perform experiments that explore the parameter space to discover features of the behaviour being investigated not yet identified. As resources in physical experimentation are extremely limited, addressing this trade-off is critical to obtaining a representative model of the system under investigation. To achieve this, a Bayesian notion of surprise has been used to effectively manage the transition between exploration and exploitation in simulated and physical experimental trials.

Item Type: Conference or Workshop Item (Paper)
Related URLs:
Divisions: Faculty of Physical Sciences and Engineering > Electronics and Computer Science > Electronic & Software Systems
Faculty of Physical Sciences and Engineering > Electronics and Computer Science > Agents, Interactions & Complexity
ePrint ID: 272579
Date Deposited: 18 Jul 2011 12:40
Last Modified: 27 Mar 2014 20:18
Further Information:Google Scholar
URI: http://eprints.soton.ac.uk/id/eprint/272579

Actions (login required)

View Item View Item