The University of Southampton
University of Southampton Institutional Repository

Detection of Social Events in Streams of Social Multimedia

Detection of Social Events in Streams of Social Multimedia
Detection of Social Events in Streams of Social Multimedia
Combining items from social media streams, such as Flickr photos and Twitter tweets, into meaningful groups can help users contextualise and consume more effectively the torrents of information continuously being made available on the social web. This task is made challenging due to the scale of the streams and the inherently multimodal nature of the information being contextualised.

The problem of grouping social media items into meaningful groups can be seen as an ill-posed and application specific unsupervised clustering problem. A fundamental question in multimodal contexts is determining which features best signify that two items should belong to the same grouping.

This paper presents a methodology which approaches social event detection as a streaming multi-modal clustering task. The methodology takes advantage of the temporal nature of social events and as a side benefit, allows for scaling to real-world datasets. Specific challenges of the social event detection task are addressed: the engineering and selection of the features used to compare items to one another; a feature fusion strategy that incorporates relative importance of features; the construction of a single sparse affinity matrix; and clustering techniques which produce meaningful item groups whilst scaling to cluster very large numbers of items.

The state-of-the-art approach presented here is evaluated using the ReSEED dataset with standardised evaluation measures. With automatically learned feature weights, we achieve an F1 score of 0.94, showing that a good compromise between precision and recall of clusters can be achieved. In a comparison with other state-of-the-art algorithms our approach is shown to give the best results.
2192-6611
289-302
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Samangooei, Sina
c380fb26-55d4-4b34-94e7-c92bbb26a40d
Niranjan, Mahesan
5cbaeea8-7288-4b55-a89c-c43d212ddd4f
Gibbins, Nicholas
98efd447-4aa7-411c-86d1-955a612eceac
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Samangooei, Sina
c380fb26-55d4-4b34-94e7-c92bbb26a40d
Niranjan, Mahesan
5cbaeea8-7288-4b55-a89c-c43d212ddd4f
Gibbins, Nicholas
98efd447-4aa7-411c-86d1-955a612eceac

Hare, Jonathon, Samangooei, Sina, Niranjan, Mahesan and Gibbins, Nicholas (2015) Detection of Social Events in Streams of Social Multimedia. International Journal of Multimedia Information Retrieval, 4 (4), 289-302. (doi:10.1007/s13735-015-0085-0).

Record type: Article

Abstract

Combining items from social media streams, such as Flickr photos and Twitter tweets, into meaningful groups can help users contextualise and consume more effectively the torrents of information continuously being made available on the social web. This task is made challenging due to the scale of the streams and the inherently multimodal nature of the information being contextualised.

The problem of grouping social media items into meaningful groups can be seen as an ill-posed and application specific unsupervised clustering problem. A fundamental question in multimodal contexts is determining which features best signify that two items should belong to the same grouping.

This paper presents a methodology which approaches social event detection as a streaming multi-modal clustering task. The methodology takes advantage of the temporal nature of social events and as a side benefit, allows for scaling to real-world datasets. Specific challenges of the social event detection task are addressed: the engineering and selection of the features used to compare items to one another; a feature fusion strategy that incorporates relative importance of features; the construction of a single sparse affinity matrix; and clustering techniques which produce meaningful item groups whilst scaling to cluster very large numbers of items.

The state-of-the-art approach presented here is evaluated using the ReSEED dataset with standardised evaluation measures. With automatically learned feature weights, we achieve an F1 score of 0.94, showing that a good compromise between precision and recall of clusters can be achieved. In a comparison with other state-of-the-art algorithms our approach is shown to give the best results.

Text
EventDetection.pdf - Accepted Manuscript
Download (833kB)

More information

Accepted/In Press date: 10 August 2015
e-pub ahead of print date: 26 August 2015
Published date: December 2015
Organisations: Web & Internet Science, Vision, Learning and Control

Identifiers

Local EPrints ID: 380227
URI: http://eprints.soton.ac.uk/id/eprint/380227
ISSN: 2192-6611
PURE UUID: 545a0d0f-fc83-4a87-aa40-58702fa3f2e1
ORCID for Jonathon Hare: ORCID iD orcid.org/0000-0003-2921-4283
ORCID for Mahesan Niranjan: ORCID iD orcid.org/0000-0001-7021-140X
ORCID for Nicholas Gibbins: ORCID iD orcid.org/0000-0002-6140-9956

Catalogue record

Date deposited: 01 Sep 2015 09:37
Last modified: 15 Mar 2024 03:29

Export record

Altmetrics

Contributors

Author: Jonathon Hare ORCID iD
Author: Sina Samangooei
Author: Mahesan Niranjan ORCID iD
Author: Nicholas Gibbins ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×