Multiple view wide-baseline trimap propagation for natural video matting

Sarim, M., Hilton, Adrian, Guillemaut, J.-Y., Kim, H. and Takai, T. (2010) Multiple view wide-baseline trimap propagation for natural video matting. 7th European Conference on Visual Media Production, , London, United Kingdom. 17 - 18 Nov 2010. pp. 82-91 . (doi:10.1109/CVMP.2010.18).

Abstract

This paper presents a method to estimate alpha mattes for video sequences of the same foreground scene from wide-baseline views given sparse key-frame trimaps in a single view. A statistical inference framework is introduced for spatio-temporal propagation of high-confidence trimap labels between video sequences without a requirement for correspondence or camera calibration and motion estimation. Multiple view trimap propagation integrates appearance information between views and over time to achieve robust labelling in the presence of shadows, changes in appearance with view point and overlap between foreground and background appearance. Results demonstrate that trimaps are sufficiently accurate to allow high-quality video matting using existing single view natural image matting algorithms. Quantitative evaluation against ground-truth demonstrates that the approach achieves accurate matte estimation for camera views separated by up to 180°, with the same amount of manual interaction required for conventional single view video matting. © 2010 IEEE.

This record has no associated files available for download.

Contributors

Author: H. Kim

Download statistics