The University of Southampton
University of Southampton Institutional Repository

3D reconstruction from stereo images for interactions between real and virtual objects

3D reconstruction from stereo images for interactions between real and virtual objects
3D reconstruction from stereo images for interactions between real and virtual objects
The 3D reconstruction algorithm in a stereo image pair for realizing mutual occlusion and interactions between the real and virtual world in an image synthesis is proposed. A two-stage algorithm, consisting of disparity estimation and regularization is used to locate a smooth and precise disparity vector. The hierarchical disparity estimation technique increases the efficiency and reliability of the estimation process, and edge-preserving disparity field regularization produces smooth disparity fields while preserving discontinuities that result from object boundaries. Depth information concerning the real scene is then recovered from the estimated disparity fields by stereo camera geometry. Simulation results show that the proposed algorithm provides accurate and spatially correlated disparity vector fields in various types of images, and the reconstructed 3D model produces a natural space in which the real world and virtual objects interact with each other as if they were in the same world.
3D reconstruction, Disparity estimation, Mixed reality, Mutual occlusion and interaction, Stereo scene analysis, Algorithms, Computer simulation, Finite element method, Mathematical models, Real time systems, Reliability, Vectors, Mutual occlusion, Image processing
0923-5965
61-75
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Sohn, K.
15547878-23a1-4428-90b5-64842ce10dff
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Sohn, K.
15547878-23a1-4428-90b5-64842ce10dff

Kim, H. and Sohn, K. (2005) 3D reconstruction from stereo images for interactions between real and virtual objects. Signal Processing: Image Communication, 20 (1), 61-75. (doi:10.1016/j.image.2004.10.004).

Record type: Article

Abstract

The 3D reconstruction algorithm in a stereo image pair for realizing mutual occlusion and interactions between the real and virtual world in an image synthesis is proposed. A two-stage algorithm, consisting of disparity estimation and regularization is used to locate a smooth and precise disparity vector. The hierarchical disparity estimation technique increases the efficiency and reliability of the estimation process, and edge-preserving disparity field regularization produces smooth disparity fields while preserving discontinuities that result from object boundaries. Depth information concerning the real scene is then recovered from the estimated disparity fields by stereo camera geometry. Simulation results show that the proposed algorithm provides accurate and spatially correlated disparity vector fields in various types of images, and the reconstructed 3D model produces a natural space in which the real world and virtual objects interact with each other as if they were in the same world.

This record has no associated files available for download.

More information

e-pub ahead of print date: 10 November 2004
Published date: January 2005
Additional Information: Cited By :30 Export Date: 30 April 2020 CODEN: SPICE
Keywords: 3D reconstruction, Disparity estimation, Mixed reality, Mutual occlusion and interaction, Stereo scene analysis, Algorithms, Computer simulation, Finite element method, Mathematical models, Real time systems, Reliability, Vectors, Mutual occlusion, Image processing

Identifiers

Local EPrints ID: 439841
URI: http://eprints.soton.ac.uk/id/eprint/439841
ISSN: 0923-5965
PURE UUID: f6128920-a55b-44b4-8cae-da8518470a3e
ORCID for H. Kim: ORCID iD orcid.org/0000-0003-4907-0491

Catalogue record

Date deposited: 05 May 2020 16:31
Last modified: 17 Mar 2024 04:01

Export record

Altmetrics

Contributors

Author: H. Kim ORCID iD
Author: K. Sohn

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×