The University of Southampton
University of Southampton Institutional Repository

Image Ranking with Implicit Feedback from Eye Movements

Image Ranking with Implicit Feedback from Eye Movements
Image Ranking with Implicit Feedback from Eye Movements
In order to help users navigate an image search system, one could provide explicit information on a small set of images as to which of them are relevant or not to their task. These rankings are learned in order to present a user with a new set of images that are relevant to their task. Requiring such explicit information may not be feasible in a number of cases, we consider the setting where the user provides implicit feedback, eye movements, to assist when performing such a task. This paper explores the idea of implicitly incorporating eye movement features in an image ranking task where only images are available during testing. Previous work had demonstrated that combining eye movement and image features improved on the retrieval accuracy when compared to using each of the sources independently. Despite these encouraging results the proposed approach is unrealistic as no eye movements will be presented a-priori for new images (i.e. only after the ranked images are presented would one be able to measure a user’s eye movements on them). We propose a novel search methodology which combines image features together with implicit feedback from users’ eye movements in a tensor ranking Support Vector Machine and show that it is possible to extract the individual source-specific weight vectors. Furthermore, we demonstrate that the decomposed image weight vector is able to construct a new image-based semantic space that outperforms the retrieval accuracy than when solely using the image-features.
Image Retrieval, Implicit Feedback, Tensor, Ranking, Support Vector Machine
291-298
Hardoon, David
e9eb22b2-daf6-460c-94b1-8208c917f862
Pasupa, Kitsuchart
952ededb-8c97-41b7-a65b-6aba31de2669
Hardoon, David
e9eb22b2-daf6-460c-94b1-8208c917f862
Pasupa, Kitsuchart
952ededb-8c97-41b7-a65b-6aba31de2669

Hardoon, David and Pasupa, Kitsuchart (2010) Image Ranking with Implicit Feedback from Eye Movements. Proceedings of the 6th Biennial Symposium on Eye Tracking Research & Applications (ETRA'2010), Austin, TX, United States. 22 - 24 Mar 2010. pp. 291-298 .

Record type: Conference or Workshop Item (Other)

Abstract

In order to help users navigate an image search system, one could provide explicit information on a small set of images as to which of them are relevant or not to their task. These rankings are learned in order to present a user with a new set of images that are relevant to their task. Requiring such explicit information may not be feasible in a number of cases, we consider the setting where the user provides implicit feedback, eye movements, to assist when performing such a task. This paper explores the idea of implicitly incorporating eye movement features in an image ranking task where only images are available during testing. Previous work had demonstrated that combining eye movement and image features improved on the retrieval accuracy when compared to using each of the sources independently. Despite these encouraging results the proposed approach is unrealistic as no eye movements will be presented a-priori for new images (i.e. only after the ranked images are presented would one be able to measure a user’s eye movements on them). We propose a novel search methodology which combines image features together with implicit feedback from users’ eye movements in a tensor ranking Support Vector Machine and show that it is possible to extract the individual source-specific weight vectors. Furthermore, we demonstrate that the decomposed image weight vector is able to construct a new image-based semantic space that outperforms the retrieval accuracy than when solely using the image-features.

Text
tensor_ranking_svm.pdf - Accepted Manuscript
Download (350kB)

More information

Published date: 22 March 2010
Additional Information: Event Dates: 22-24 March 2010
Venue - Dates: Proceedings of the 6th Biennial Symposium on Eye Tracking Research & Applications (ETRA'2010), Austin, TX, United States, 2010-03-22 - 2010-03-24
Keywords: Image Retrieval, Implicit Feedback, Tensor, Ranking, Support Vector Machine
Organisations: Electronics & Computer Science

Identifiers

Local EPrints ID: 268501
URI: http://eprints.soton.ac.uk/id/eprint/268501
PURE UUID: 9bea6ba1-3b0a-4cf8-a961-b312fc263295

Catalogue record

Date deposited: 12 Feb 2010 00:01
Last modified: 14 Mar 2024 09:11

Export record

Contributors

Author: David Hardoon
Author: Kitsuchart Pasupa

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×