The University of Southampton
University of Southampton Institutional Repository

Detection of Social Events in Streams of Social Multimedia

Hare, Jonathon, Samangooei, Sina, Niranjan, Mahesan and Gibbins, Nicholas (2015) Detection of Social Events in Streams of Social Multimedia International Journal of Multimedia Information Retrieval, 4, (4), pp. 289-302.

Record type: Article


Combining items from social media streams, such as Flickr photos and Twitter tweets, into mean- ingful groups can help users contextualise and consume more effectively the torrents of information continu- ously being made available on the social web. This task is made challenging due to the scale of the streams and the inherently multimodal nature of the information being contextualised.

The problem of grouping social media items into meaningful groups can be seen as an ill-posed and application specific unsupervised clustering problem. A fundamental question in multimodal contexts is determining which features best signify that two items should belong to the same grouping.

This paper presents a methodology which approaches social event detection as a streaming multi-modal clus- tering task. The methodology takes advantage of the temporal nature of social events and as a side benefit, allows for scaling to real-world datasets. Specific challenges of the social event detection task are addressed: the engineering and selection of the features used to compare items to one another; a feature fusion strategy that incorporates relative importance of features; the construction of a single sparse affinity matrix; and clustering techniques which produce meaningful item groups whilst scaling to cluster very large numbers of items.

The state-of-the-art approach presented here is evaluated using the ReSEED dataset with standardised evaluation measures. With automatically learned feature weights, we achieve an F1 score of 0.94, showing that a good compromise between precision and recall of clusters can be achieved. In a comparison with other state- of-the-art algorithms our approach is shown to give the best results.

PDF EventDetection.pdf - Accepted Manuscript
Download (833kB)

More information

Accepted/In Press date: 10 August 2015
e-pub ahead of print date: 26 August 2015
Organisations: Web & Internet Science, Vision, Learning and Control


Local EPrints ID: 380227
ISSN: 2192-6611
PURE UUID: 545a0d0f-fc83-4a87-aa40-58702fa3f2e1
ORCID for Jonathon Hare: ORCID iD
ORCID for Nicholas Gibbins: ORCID iD

Catalogue record

Date deposited: 01 Sep 2015 09:37
Last modified: 14 Oct 2017 12:24

Export record


Author: Jonathon Hare ORCID iD
Author: Sina Samangooei
Author: Nicholas Gibbins ORCID iD

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.