Saliency-based Models of Image Content and their Application to Auto-Annotation by Semantic Propagation
Saliency-based Models of Image Content and their Application to Auto-Annotation by Semantic Propagation
In this paper, we propose a model of automatic image annotation based on propagation of keywords. The model works on the premise that visually similar image content is likely to have similar semantic content. Image content is extracted using local descriptors at salient points within the image and quantising the feature-vectors into visual terms. The visual terms for each image are modelled using techniques taken from the information retrieval community. The modelled information from an unlabelled query image is compared to the models of a corpus of labelled images and labels are propagated from the most similar labelled images to the query image.
Saliency, auto-annotation, vector-space, latent semantic indexing
Hare, Jonathon S.
65ba2cda-eaaf-4767-a325-cd845504e5a9
Lewis, Paul H.
7aa6c6d9-bc69-4e19-b2ac-a6e20558c020
2005
Hare, Jonathon S.
65ba2cda-eaaf-4767-a325-cd845504e5a9
Lewis, Paul H.
7aa6c6d9-bc69-4e19-b2ac-a6e20558c020
Hare, Jonathon S. and Lewis, Paul H.
(2005)
Saliency-based Models of Image Content and their Application to Auto-Annotation by Semantic Propagation.
Multimedia and the Semantic Web / European Semantic Web Conference 2005, Heraklion, Crete.
Record type:
Conference or Workshop Item
(Paper)
Abstract
In this paper, we propose a model of automatic image annotation based on propagation of keywords. The model works on the premise that visually similar image content is likely to have similar semantic content. Image content is extracted using local descriptors at salient points within the image and quantising the feature-vectors into visual terms. The visual terms for each image are modelled using techniques taken from the information retrieval community. The modelled information from an unlabelled query image is compared to the models of a corpus of labelled images and labels are propagated from the most similar labelled images to the query image.
More information
Published date: 2005
Additional Information:
Event Dates: 29/5/2005
Venue - Dates:
Multimedia and the Semantic Web / European Semantic Web Conference 2005, Heraklion, Crete, 2005-05-29
Keywords:
Saliency, auto-annotation, vector-space, latent semantic indexing
Organisations:
Web & Internet Science
Identifiers
Local EPrints ID: 260954
URI: http://eprints.soton.ac.uk/id/eprint/260954
PURE UUID: 92ed07e7-5d40-46dd-a3a1-3af106e377da
Catalogue record
Date deposited: 24 Jun 2005
Last modified: 15 Mar 2024 03:25
Export record
Contributors
Author:
Jonathon S. Hare
Author:
Paul H. Lewis
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics