The University of Southampton
University of Southampton Institutional Repository

Extended Markov Tracking with Ensemble Actions

Rabinovich, Zinovi and Jennings, Nick (2009) Extended Markov Tracking with Ensemble Actions At International Workshop on Hybrid Control of Autonomous Systems.

Record type: Conference or Workshop Item (Paper)


In this paper we extend the control methodology based on Extended Markov Tracking (EMT) by providing the control algorithm with capabilities to calibrate and even partially reconstruct the environment's model. This enables us to resolve the problem of performance deterioration due to model incoherence, a negative problem in all model based control methods. The new algorithm, Ensemble Actions EMT (EA-EMT), utilises the initial environment model as a library of state transition functions and applies a variation of prediction with experts to assemble and calibrate a revised model. By so doing, this is the first control algorithm that enables on-line adaptation within the Dynamics Based Control (DBC) framework. In our experiments, we performed a range of tests with increasing model incoherence induced by three types of exogenous environment perturbations: catastrophic, periodic and deviating. The results show that EA-EMT resolved model incoherence and significantly outperformed the best currently available DBC solution by up to $95\%$.

PDF hycas.pdf - Author's Original
Download (143kB)

More information

Published date: 13 July 2009
Venue - Dates: International Workshop on Hybrid Control of Autonomous Systems, 2009-07-13
Organisations: Agents, Interactions & Complexity


Local EPrints ID: 267337
PURE UUID: 869d81f5-adca-4961-adcd-725641df75f9

Catalogue record

Date deposited: 07 May 2009 11:55
Last modified: 18 Jul 2017 07:05

Export record


Author: Zinovi Rabinovich
Author: Nick Jennings

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.