The University of Southampton
University of Southampton Institutional Repository

3D reconstruction of stereo images for interaction between real and virtual worlds

3D reconstruction of stereo images for interaction between real and virtual worlds
3D reconstruction of stereo images for interaction between real and virtual worlds
Mixed reality is different from the virtual reality in that users can feel immersed in a space which is composed of not only virtual but also real objects. Thus, it is essential to realize seamless integration and interaction of the virtual and real worlds. We need depth information of the real scene to synthesize the real and virtual objects. We propose a two-stage algorithm to find smooth and precise disparity vector fields with sharp object boundaries in a stereo image pair for depth estimation. Hierarchical region-dividing disparity estimation increases the efficiency and the reliability of the estimation process, and a shape-adaptive window provides high reliability of the fields around the object boundary region. At the second stage, the vector fields are regularized with a energy model which produces smooth fields while preserving their discontinuities resulting from the object boundaries. The vector fields are used to reconstruct 3D surface of the real scene. Simulation results show that the proposed algorithm provides accurate and spatially correlated disparity vector fields in various kinds of images, and synthesized 3D models produce natural space where the virtual objects interact with the real world as if they are in the same world. © 2003 IEEE.
Augmented reality, Face recognition, Image coding, Interactive computer graphics, Three dimensional computer graphics, Vector spaces, Vectors, Virtual reality, 3D reconstruction, Depth information, Disparity estimations, Estimation process, Object boundaries, Seamless integration, Stereo image pairs, Two-stage algorithm, Stereo image processing
169-176
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Yang, S.-J.
6c3aab44-8e9a-4977-af73-6c1609aa9c7c
Sohn, K.
15547878-23a1-4428-90b5-64842ce10dff
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Yang, S.-J.
6c3aab44-8e9a-4977-af73-6c1609aa9c7c
Sohn, K.
15547878-23a1-4428-90b5-64842ce10dff

Kim, H., Yang, S.-J. and Sohn, K. (2003) 3D reconstruction of stereo images for interaction between real and virtual worlds. ACM International Symposium on Mixed and Augmented Reality. pp. 169-176 . (doi:10.1109/ISMAR.2003.1240700).

Record type: Conference or Workshop Item (Paper)

Abstract

Mixed reality is different from the virtual reality in that users can feel immersed in a space which is composed of not only virtual but also real objects. Thus, it is essential to realize seamless integration and interaction of the virtual and real worlds. We need depth information of the real scene to synthesize the real and virtual objects. We propose a two-stage algorithm to find smooth and precise disparity vector fields with sharp object boundaries in a stereo image pair for depth estimation. Hierarchical region-dividing disparity estimation increases the efficiency and the reliability of the estimation process, and a shape-adaptive window provides high reliability of the fields around the object boundary region. At the second stage, the vector fields are regularized with a energy model which produces smooth fields while preserving their discontinuities resulting from the object boundaries. The vector fields are used to reconstruct 3D surface of the real scene. Simulation results show that the proposed algorithm provides accurate and spatially correlated disparity vector fields in various kinds of images, and synthesized 3D models produce natural space where the virtual objects interact with the real world as if they are in the same world. © 2003 IEEE.

Full text not available from this repository.

More information

Published date: 27 October 2003
Additional Information: cited By 21
Venue - Dates: ACM International Symposium on Mixed and Augmented Reality, 2003-04-17
Keywords: Augmented reality, Face recognition, Image coding, Interactive computer graphics, Three dimensional computer graphics, Vector spaces, Vectors, Virtual reality, 3D reconstruction, Depth information, Disparity estimations, Estimation process, Object boundaries, Seamless integration, Stereo image pairs, Two-stage algorithm, Stereo image processing

Identifiers

Local EPrints ID: 439818
URI: http://eprints.soton.ac.uk/id/eprint/439818
PURE UUID: dcb8ab1f-332f-49a0-ae12-701349f2abd1
ORCID for H. Kim: ORCID iD orcid.org/0000-0003-4907-0491

Catalogue record

Date deposited: 05 May 2020 16:30
Last modified: 23 May 2020 00:47

Export record

Altmetrics

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×