The University of Southampton
University of Southampton Institutional Repository

4D match trees for non-rigid surface alignment

4D match trees for non-rigid surface alignment
4D match trees for non-rigid surface alignment
This paper presents a method for dense 4D temporal alignment of partial reconstructions of non-rigid surfaces observed from single or multiple moving cameras of complex scenes. 4D Match Trees are introduced for robust global alignment of non-rigid shape based on the similarity between images across sequences and views. Wide-timeframe sparse correspondence between arbitrary pairs of images is established using a segmentation-based feature detector (SFD) which is demonstrated to give improved matching of non-rigid shape. Sparse SFD correspondence allows the similarity between any pair of image frames to be estimated for moving cameras and multiple views. This enables the 4D Match Tree to be constructed which minimises the observed change in non-rigid shape for global alignment across all images. Dense 4D temporal correspondence across all frames is then estimated by traversing the 4D Match tree using optical flow initialised from the sparse feature matches. The approach is evaluated on single and multiple view images sequences for alignment of partial surface reconstructions of dynamic objects in complex indoor and outdoor scenes to obtain a temporally consistent 4D representation. Comparison to previous 2D and 3D scene flow demonstrates that 4D Match Trees achieve reduced errors due to drift and improved robustness to large non-rigid deformations.
Alignment, Cameras, Computer vision, Feature extraction, Image segmentation, Dynamic scenes
213-229
Springer
Mustafa, Armin
29037014-ab45-4368-81e3-6b698e9bbbd0
Kim, Hansung
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Hilton, Adrian
12782a55-4c4d-4dfb-a690-62505f6665db
Leibe, B
Matas, J.
Sebe, N.
Welling, M.
Mustafa, Armin
29037014-ab45-4368-81e3-6b698e9bbbd0
Kim, Hansung
2c7c135c-f00b-4409-acb2-85b3a9e8225f
Hilton, Adrian
12782a55-4c4d-4dfb-a690-62505f6665db
Leibe, B
Matas, J.
Sebe, N.
Welling, M.

Mustafa, Armin, Kim, Hansung and Hilton, Adrian (2016) 4D match trees for non-rigid surface alignment. Leibe, B, Matas, J., Sebe, N. and Welling, M. (eds.) In Computer Vision – ECCV 2016. vol. 9905, Springer. pp. 213-229 . (doi:10.1007/978-3-319-46448-0_13).

Record type: Conference or Workshop Item (Paper)

Abstract

This paper presents a method for dense 4D temporal alignment of partial reconstructions of non-rigid surfaces observed from single or multiple moving cameras of complex scenes. 4D Match Trees are introduced for robust global alignment of non-rigid shape based on the similarity between images across sequences and views. Wide-timeframe sparse correspondence between arbitrary pairs of images is established using a segmentation-based feature detector (SFD) which is demonstrated to give improved matching of non-rigid shape. Sparse SFD correspondence allows the similarity between any pair of image frames to be estimated for moving cameras and multiple views. This enables the 4D Match Tree to be constructed which minimises the observed change in non-rigid shape for global alignment across all images. Dense 4D temporal correspondence across all frames is then estimated by traversing the 4D Match tree using optical flow initialised from the sparse feature matches. The approach is evaluated on single and multiple view images sequences for alignment of partial surface reconstructions of dynamic objects in complex indoor and outdoor scenes to obtain a temporally consistent 4D representation. Comparison to previous 2D and 3D scene flow demonstrates that 4D Match Trees achieve reduced errors due to drift and improved robustness to large non-rigid deformations.

Full text not available from this repository.

More information

e-pub ahead of print date: 17 September 2016
Published date: 2016
Venue - Dates: European Conference on Computer Vision, Netherlands, 2016-10-08
Keywords: Alignment, Cameras, Computer vision, Feature extraction, Image segmentation, Dynamic scenes

Identifiers

Local EPrints ID: 440595
URI: http://eprints.soton.ac.uk/id/eprint/440595
PURE UUID: eb799611-be0d-4f2b-a9a1-cc4a31a5160a
ORCID for Hansung Kim: ORCID iD orcid.org/0000-0003-4907-0491

Catalogue record

Date deposited: 12 May 2020 16:30
Last modified: 24 Jun 2020 00:48

Export record

Altmetrics

Contributors

Author: Armin Mustafa
Author: Hansung Kim ORCID iD
Author: Adrian Hilton
Editor: B Leibe
Editor: J. Matas
Editor: N. Sebe
Editor: M. Welling

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×