The University of Southampton
University of Southampton Institutional Repository

Machine learning in signalized junction control algorithms

Box, Simon and Waterson, Ben (2011) Machine learning in signalized junction control algorithms At 43rd Annual Conference of the Universities' Transport Study Group (UTSG), United Kingdom. 05 - 07 Jan 2011.

Record type: Conference or Workshop Item (Paper)


Machine learning techniques can be applied to develop signalized junction control algorithms that can learn control strategies from examples of good control and from experience. This paper discusses the conceptual differences between the conventional approach to signal control and the machine learning approach. An example is presented where a junction control agent was developed to learn strategies from a human expert. This learning junction agent uses localization probe data from vehicles and a system of bids to describe the state of the network. The junction agent learns from the human expert by employing a Neural Network to classify its bid space based on evidence of the human’s decision making.
Simulation experiments are used to evaluate the performance of learning junction agent and these show that the agent can outperform the High Bid signal control system both in terms of delay and in terms of equitability. The paper concludes with a discussion on how the approach described above can be extended to allow the junction control agent to learn from observational data and experience using reinforcement learning.

Full text not available from this repository.

More information

Published date: January 2011
Venue - Dates: 43rd Annual Conference of the Universities' Transport Study Group (UTSG), United Kingdom, 2011-01-05 - 2011-01-07
Organisations: Transportation Group


Local EPrints ID: 207815
PURE UUID: 1134cc5e-cb73-4292-8080-1e223d004c9f
ORCID for Ben Waterson: ORCID iD

Catalogue record

Date deposited: 12 Jan 2012 14:28
Last modified: 18 Jul 2017 10:49

Export record

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.