The University of Southampton
University of Southampton Institutional Repository

Detection of 3D position of eyes through a consumer RGB-D camera for stereoscopic mixed reality environments

Detection of 3D position of eyes through a consumer RGB-D camera for stereoscopic mixed reality environments
Detection of 3D position of eyes through a consumer RGB-D camera for stereoscopic mixed reality environments

A novel approach to track the 3D position of the user's eyes in stereoscopic virtual environments, where stereo glasses are worn, is proposed. Such an approach improves a state-of-the-art real-time face tracking algorithm by addressing the occlusion due the stereo glasses and providing estimation of eye position based on biométrie features. More generally, our solution can be seen as a proof of concept for a more robust approach to improving motion tracking techniques. In particular, the proposed technique yields accurate and stable estimates of the 3D position of the user's eyes, while the user moves in front of the stereoscopic display. The correct tracking of both eyes' 3D position is a crucial step in order to achieve a more natural human-computer interaction which diminishes visual fatigue. The proposed approach is validated through quantitative tests: (i) we assessed the accuracy of our algorithm for tracking the 3D position of users' eyes with and without stereo glasses; (ii) we have performed a perceptual assessment of the natural interaction in the virtual environments through experimental sessions with several users.

Augmented reality, computer vision, Human-computer interactions, stereoscopic 3D entertainment system, Virtual reality
IEEE
Chessa, Manuela
6a3ac515-782f-44a0-9a4e-85ffceb710c5
Garibotti, Matteo
e9bc2928-8267-477f-a3d5-8e61863939f0
Maiello, Guido
c122b089-1bbc-4d3e-b178-b0a1b31a5295
Caroggio, Lorenzo
774b40b1-e5c5-432a-ad3c-b67b650e6a92
Huang, Huayi
508efc2b-f0df-4f25-9425-c337bed5cf5a
Sabatini, Silvio
09f87e2c-be31-4ffe-8a4d-03904430e840
Solari, Fabio
da14eec1-53f6-45a5-913b-5c13282c1e8e
Chessa, Manuela
6a3ac515-782f-44a0-9a4e-85ffceb710c5
Garibotti, Matteo
e9bc2928-8267-477f-a3d5-8e61863939f0
Maiello, Guido
c122b089-1bbc-4d3e-b178-b0a1b31a5295
Caroggio, Lorenzo
774b40b1-e5c5-432a-ad3c-b67b650e6a92
Huang, Huayi
508efc2b-f0df-4f25-9425-c337bed5cf5a
Sabatini, Silvio
09f87e2c-be31-4ffe-8a4d-03904430e840
Solari, Fabio
da14eec1-53f6-45a5-913b-5c13282c1e8e

Chessa, Manuela, Garibotti, Matteo, Maiello, Guido, Caroggio, Lorenzo, Huang, Huayi, Sabatini, Silvio and Solari, Fabio (2014) Detection of 3D position of eyes through a consumer RGB-D camera for stereoscopic mixed reality environments. In 2014 International Conference on 3D Imaging, IC3D 2014 - Proceedings. IEEE.. (doi:10.1109/IC3D.2014.7032592).

Record type: Conference or Workshop Item (Paper)

Abstract

A novel approach to track the 3D position of the user's eyes in stereoscopic virtual environments, where stereo glasses are worn, is proposed. Such an approach improves a state-of-the-art real-time face tracking algorithm by addressing the occlusion due the stereo glasses and providing estimation of eye position based on biométrie features. More generally, our solution can be seen as a proof of concept for a more robust approach to improving motion tracking techniques. In particular, the proposed technique yields accurate and stable estimates of the 3D position of the user's eyes, while the user moves in front of the stereoscopic display. The correct tracking of both eyes' 3D position is a crucial step in order to achieve a more natural human-computer interaction which diminishes visual fatigue. The proposed approach is validated through quantitative tests: (i) we assessed the accuracy of our algorithm for tracking the 3D position of users' eyes with and without stereo glasses; (ii) we have performed a perceptual assessment of the natural interaction in the virtual environments through experimental sessions with several users.

This record has no associated files available for download.

More information

Published date: 9 December 2014
Additional Information: Publisher Copyright: © 2014 IEEE.
Venue - Dates: 4th International Conference on 3D Imaging, IC3D 2014, , Liege, Belgium, 2014-12-09 - 2014-12-10
Keywords: Augmented reality, computer vision, Human-computer interactions, stereoscopic 3D entertainment system, Virtual reality

Identifiers

Local EPrints ID: 485055
URI: http://eprints.soton.ac.uk/id/eprint/485055
PURE UUID: d6c4fa15-2d2d-4d1c-9363-ef21510b7a85
ORCID for Guido Maiello: ORCID iD orcid.org/0000-0001-6625-2583

Catalogue record

Date deposited: 28 Nov 2023 18:04
Last modified: 18 Mar 2024 04:11

Export record

Altmetrics

Contributors

Author: Manuela Chessa
Author: Matteo Garibotti
Author: Guido Maiello ORCID iD
Author: Lorenzo Caroggio
Author: Huayi Huang
Author: Silvio Sabatini
Author: Fabio Solari

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×