Detection of 3D position of eyes through a consumer RGB-D camera for stereoscopic mixed reality environments
Detection of 3D position of eyes through a consumer RGB-D camera for stereoscopic mixed reality environments
A novel approach to track the 3D position of the user's eyes in stereoscopic virtual environments, where stereo glasses are worn, is proposed. Such an approach improves a state-of-the-art real-time face tracking algorithm by addressing the occlusion due the stereo glasses and providing estimation of eye position based on biométrie features. More generally, our solution can be seen as a proof of concept for a more robust approach to improving motion tracking techniques. In particular, the proposed technique yields accurate and stable estimates of the 3D position of the user's eyes, while the user moves in front of the stereoscopic display. The correct tracking of both eyes' 3D position is a crucial step in order to achieve a more natural human-computer interaction which diminishes visual fatigue. The proposed approach is validated through quantitative tests: (i) we assessed the accuracy of our algorithm for tracking the 3D position of users' eyes with and without stereo glasses; (ii) we have performed a perceptual assessment of the natural interaction in the virtual environments through experimental sessions with several users.
Augmented reality, computer vision, Human-computer interactions, stereoscopic 3D entertainment system, Virtual reality
Chessa, Manuela
6a3ac515-782f-44a0-9a4e-85ffceb710c5
Garibotti, Matteo
e9bc2928-8267-477f-a3d5-8e61863939f0
Maiello, Guido
c122b089-1bbc-4d3e-b178-b0a1b31a5295
Caroggio, Lorenzo
774b40b1-e5c5-432a-ad3c-b67b650e6a92
Huang, Huayi
508efc2b-f0df-4f25-9425-c337bed5cf5a
Sabatini, Silvio
09f87e2c-be31-4ffe-8a4d-03904430e840
Solari, Fabio
da14eec1-53f6-45a5-913b-5c13282c1e8e
9 December 2014
Chessa, Manuela
6a3ac515-782f-44a0-9a4e-85ffceb710c5
Garibotti, Matteo
e9bc2928-8267-477f-a3d5-8e61863939f0
Maiello, Guido
c122b089-1bbc-4d3e-b178-b0a1b31a5295
Caroggio, Lorenzo
774b40b1-e5c5-432a-ad3c-b67b650e6a92
Huang, Huayi
508efc2b-f0df-4f25-9425-c337bed5cf5a
Sabatini, Silvio
09f87e2c-be31-4ffe-8a4d-03904430e840
Solari, Fabio
da14eec1-53f6-45a5-913b-5c13282c1e8e
Chessa, Manuela, Garibotti, Matteo, Maiello, Guido, Caroggio, Lorenzo, Huang, Huayi, Sabatini, Silvio and Solari, Fabio
(2014)
Detection of 3D position of eyes through a consumer RGB-D camera for stereoscopic mixed reality environments.
In 2014 International Conference on 3D Imaging, IC3D 2014 - Proceedings.
IEEE..
(doi:10.1109/IC3D.2014.7032592).
Record type:
Conference or Workshop Item
(Paper)
Abstract
A novel approach to track the 3D position of the user's eyes in stereoscopic virtual environments, where stereo glasses are worn, is proposed. Such an approach improves a state-of-the-art real-time face tracking algorithm by addressing the occlusion due the stereo glasses and providing estimation of eye position based on biométrie features. More generally, our solution can be seen as a proof of concept for a more robust approach to improving motion tracking techniques. In particular, the proposed technique yields accurate and stable estimates of the 3D position of the user's eyes, while the user moves in front of the stereoscopic display. The correct tracking of both eyes' 3D position is a crucial step in order to achieve a more natural human-computer interaction which diminishes visual fatigue. The proposed approach is validated through quantitative tests: (i) we assessed the accuracy of our algorithm for tracking the 3D position of users' eyes with and without stereo glasses; (ii) we have performed a perceptual assessment of the natural interaction in the virtual environments through experimental sessions with several users.
This record has no associated files available for download.
More information
Published date: 9 December 2014
Additional Information:
Publisher Copyright:
© 2014 IEEE.
Venue - Dates:
4th International Conference on 3D Imaging, IC3D 2014, , Liege, Belgium, 2014-12-09 - 2014-12-10
Keywords:
Augmented reality, computer vision, Human-computer interactions, stereoscopic 3D entertainment system, Virtual reality
Identifiers
Local EPrints ID: 485055
URI: http://eprints.soton.ac.uk/id/eprint/485055
PURE UUID: d6c4fa15-2d2d-4d1c-9363-ef21510b7a85
Catalogue record
Date deposited: 28 Nov 2023 18:04
Last modified: 18 Mar 2024 04:11
Export record
Altmetrics
Contributors
Author:
Manuela Chessa
Author:
Matteo Garibotti
Author:
Guido Maiello
Author:
Lorenzo Caroggio
Author:
Huayi Huang
Author:
Silvio Sabatini
Author:
Fabio Solari
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics