The University of Southampton
University of Southampton Institutional Repository

Outdoor dynamic 3-D scene reconstruction

Outdoor dynamic 3-D scene reconstruction
Outdoor dynamic 3-D scene reconstruction
Existing systems for 3-D reconstruction from multiple view video use controlled indoor environments with uniform illumination and backgrounds to allow accurate segmentation of dynamic foreground objects. In this paper, we present a portable system for 3-D reconstruction of dynamic outdoor scenes that require relatively large capture volumes with complex backgrounds and nonuniform illumination. This is motivated by the demand for 3-D reconstruction of natural outdoor scenes to support film and broadcast production. Limitations of existing multiple view 3-D reconstruction techniques for use in outdoor scenes are identified. Outdoor 3-D scene reconstruction is performed in three stages: 1) 3-D background scene modeling using spherical stereo image capture; 2) multiple view segmentation of dynamic foreground objects by simultaneous video matting across multiple views; and 3) robust 3-D foreground reconstruction and multiple view segmentation refinement in the presence of segmentation and calibration errors. Evaluation is performed on several outdoor productions with complex dynamic scenes including people and animals. Results demonstrate that the proposed approach overcomes limitations of previous indoor multiple view reconstruction approaches enabling high-quality free-viewpoint rendering and 3-D reference models for production. © 2012 IEEE.
3D reconstruction, Free-viewpoint video, Image-based, Image-Based Rendering, Multiple view reconstruction, Non-uniform illumination, Scene reconstruction, Uniform illumination, Communication channels (information theory), Computer vision, Image reconstruction, Three dimensional computer graphics, Three dimensional
1611-1622
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Guillemaut, J.-Y.
fcaefbd8-8ba1-4c43-978c-0b5d432a3285
Takai, T.
53894c03-6042-4bc8-86fb-692161fd22bb
Sarim, M.
1242380f-3b23-491b-ab75-85daccc93f92
Hilton, Adrian
12782a55-4c4d-4dfb-a690-62505f6665db
Kim, H.
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Guillemaut, J.-Y.
fcaefbd8-8ba1-4c43-978c-0b5d432a3285
Takai, T.
53894c03-6042-4bc8-86fb-692161fd22bb
Sarim, M.
1242380f-3b23-491b-ab75-85daccc93f92
Hilton, Adrian
12782a55-4c4d-4dfb-a690-62505f6665db

Kim, H., Guillemaut, J.-Y., Takai, T., Sarim, M. and Hilton, Adrian (2012) Outdoor dynamic 3-D scene reconstruction. IEEE Transactions on Circuits and Systems for Video Technology, 22 (11), 1611-1622. (doi:10.1109/TCSVT.2012.2202185).

Record type: Article

Abstract

Existing systems for 3-D reconstruction from multiple view video use controlled indoor environments with uniform illumination and backgrounds to allow accurate segmentation of dynamic foreground objects. In this paper, we present a portable system for 3-D reconstruction of dynamic outdoor scenes that require relatively large capture volumes with complex backgrounds and nonuniform illumination. This is motivated by the demand for 3-D reconstruction of natural outdoor scenes to support film and broadcast production. Limitations of existing multiple view 3-D reconstruction techniques for use in outdoor scenes are identified. Outdoor 3-D scene reconstruction is performed in three stages: 1) 3-D background scene modeling using spherical stereo image capture; 2) multiple view segmentation of dynamic foreground objects by simultaneous video matting across multiple views; and 3) robust 3-D foreground reconstruction and multiple view segmentation refinement in the presence of segmentation and calibration errors. Evaluation is performed on several outdoor productions with complex dynamic scenes including people and animals. Results demonstrate that the proposed approach overcomes limitations of previous indoor multiple view reconstruction approaches enabling high-quality free-viewpoint rendering and 3-D reference models for production. © 2012 IEEE.

Full text not available from this repository.

More information

Published date: 1 June 2012
Additional Information: cited By 16
Keywords: 3D reconstruction, Free-viewpoint video, Image-based, Image-Based Rendering, Multiple view reconstruction, Non-uniform illumination, Scene reconstruction, Uniform illumination, Communication channels (information theory), Computer vision, Image reconstruction, Three dimensional computer graphics, Three dimensional

Identifiers

Local EPrints ID: 440580
URI: http://eprints.soton.ac.uk/id/eprint/440580
PURE UUID: b6dcefbf-5e8d-4575-acfe-610cd8542068
ORCID for H. Kim: ORCID iD orcid.org/0000-0003-4907-0491

Catalogue record

Date deposited: 07 May 2020 16:37
Last modified: 28 May 2020 00:49

Export record

Altmetrics

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×