The University of Southampton
University of Southampton Institutional Repository

Hierarchical depth estimation for image synthesis in mixed reality

Hierarchical depth estimation for image synthesis in mixed reality
Hierarchical depth estimation for image synthesis in mixed reality
Mixed reality is different from the virtual reality in that users can feel immersed in a space which is composed of not only virtual but also real objects. Thus, it is essential to realize seamless integration and mutual occlusion of the virtual and real worlds. Therefore, we need depth information of the real scene to perform the synthesis. We propose the depth estimation algorithm with sharp object boundaries for mixed reality system based on hierarchical disparity estimation. Initial disparity vectors are obtained from downsampled stereo images using region-dividing disparity estimation technique. Then, background region is detected and flattened. With these initial vectors, dense disparities are estimated and regularized with shape-adaptive window in full resolution images. Finally, depth values are calculated by stereo geometry and camera parameters. As a result, virtual objects can be mixed into the image of real world by comparing the calculated depth values with the depth information of generated virtual objects. Experimental results show that occlusion between the virtual and real objects are correctly established with sharp boundaries in the synthesized images, so that user can observe the mixed scene with considerably natural sensation.
Depth estimation, Disparity estimation, Image synthesis, Mixed reality, Algorithms, Cameras, Depth perception, Estimation, Geometry, Image processing, Stereo vision, Virtual reality
544-553
SPIE
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Sohn, K.
15547878-23a1-4428-90b5-64842ce10dff
Woods, Andrew J.
Merritt, John O.
Benton, Stephen A.
Bolas, Mark T.
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Sohn, K.
15547878-23a1-4428-90b5-64842ce10dff
Woods, Andrew J.
Merritt, John O.
Benton, Stephen A.
Bolas, Mark T.

Kim, H. and Sohn, K. (2003) Hierarchical depth estimation for image synthesis in mixed reality. Woods, Andrew J., Merritt, John O., Benton, Stephen A. and Bolas, Mark T. (eds.) In Stereoscopic Displays and Virtual Reality Systems X. SPIE. pp. 544-553 . (doi:10.1117/12.473879).

Record type: Conference or Workshop Item (Paper)

Abstract

Mixed reality is different from the virtual reality in that users can feel immersed in a space which is composed of not only virtual but also real objects. Thus, it is essential to realize seamless integration and mutual occlusion of the virtual and real worlds. Therefore, we need depth information of the real scene to perform the synthesis. We propose the depth estimation algorithm with sharp object boundaries for mixed reality system based on hierarchical disparity estimation. Initial disparity vectors are obtained from downsampled stereo images using region-dividing disparity estimation technique. Then, background region is detected and flattened. With these initial vectors, dense disparities are estimated and regularized with shape-adaptive window in full resolution images. Finally, depth values are calculated by stereo geometry and camera parameters. As a result, virtual objects can be mixed into the image of real world by comparing the calculated depth values with the depth information of generated virtual objects. Experimental results show that occlusion between the virtual and real objects are correctly established with sharp boundaries in the synthesized images, so that user can observe the mixed scene with considerably natural sensation.

Full text not available from this repository.

More information

Published date: 30 May 2003
Additional Information: Cited By :9 Export Date: 30 April 2020 CODEN: PSISD
Venue - Dates: SPIE, San Jose, CA, United States, 2003-01-25 - 2003-01-31
Keywords: Depth estimation, Disparity estimation, Image synthesis, Mixed reality, Algorithms, Cameras, Depth perception, Estimation, Geometry, Image processing, Stereo vision, Virtual reality

Identifiers

Local EPrints ID: 439820
URI: http://eprints.soton.ac.uk/id/eprint/439820
PURE UUID: 0c4a04a7-e677-4f08-9088-f05e504ec789
ORCID for H. Kim: ORCID iD orcid.org/0000-0003-4907-0491

Catalogue record

Date deposited: 05 May 2020 16:30
Last modified: 23 May 2020 00:47

Export record

Altmetrics

Contributors

Author: H. Kim ORCID iD
Author: K. Sohn
Editor: Andrew J. Woods
Editor: John O. Merritt
Editor: Stephen A. Benton
Editor: Mark T. Bolas

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×