Detection of Social Events in Streams of Social Multimedia

Hare, Jonathon, Samangooei, Sina, Niranjan, Mahesan and Gibbins, Nicholas (2015) Detection of Social Events in Streams of Social Multimedia International Journal of Multimedia Information Retrieval, 4, (4), pp. 289-302. (doi:10.1007/s13735-015-0085-0).


[img] PDF EventDetection.pdf - Accepted Manuscript
Download (833kB)


Combining items from social media streams, such as Flickr photos and Twitter tweets, into mean- ingful groups can help users contextualise and consume more effectively the torrents of information continu- ously being made available on the social web. This task is made challenging due to the scale of the streams and the inherently multimodal nature of the information being contextualised.

The problem of grouping social media items into meaningful groups can be seen as an ill-posed and application specific unsupervised clustering problem. A fundamental question in multimodal contexts is determining which features best signify that two items should belong to the same grouping.

This paper presents a methodology which approaches social event detection as a streaming multi-modal clus- tering task. The methodology takes advantage of the temporal nature of social events and as a side benefit, allows for scaling to real-world datasets. Specific challenges of the social event detection task are addressed: the engineering and selection of the features used to compare items to one another; a feature fusion strategy that incorporates relative importance of features; the construction of a single sparse affinity matrix; and clustering techniques which produce meaningful item groups whilst scaling to cluster very large numbers of items.

The state-of-the-art approach presented here is evaluated using the ReSEED dataset with standardised evaluation measures. With automatically learned feature weights, we achieve an F1 score of 0.94, showing that a good compromise between precision and recall of clusters can be achieved. In a comparison with other state- of-the-art algorithms our approach is shown to give the best results.

Item Type: Article
Digital Object Identifier (DOI): doi:10.1007/s13735-015-0085-0
ISSNs: 2192-6611 (print)
Organisations: Web & Internet Science, Vision, Learning and Control
ePrint ID: 380227
Date :
Date Event
10 August 2015Accepted/In Press
26 August 2015e-pub ahead of print
Date Deposited: 01 Sep 2015 09:37
Last Modified: 17 Apr 2017 05:26
Further Information:Google Scholar

Actions (login required)

View Item View Item