Skip to main content

Research Repository

Advanced Search

Robust deformable shape reconstruction from monocular video with manifold forests

Matuszewski, Bogdan J.; Tao, Lili; Matuszewski, Bogdan

Robust deformable shape reconstruction from monocular video with manifold forests Thumbnail


Authors

Bogdan J. Matuszewski

Lili Tao

Bogdan Matuszewski



Abstract

© 2016, The Author(s). Existing approaches to recover structure of 3D deformable objects and camera motion parameters from an uncalibrated images assume the object’s shape could be modelled well by a linear subspace. These methods have been proven effective and well suited when the deformations are relatively small, but fail to reconstruct the objects with relatively large deformations. This paper describes a novel approach for 3D non-rigid shape reconstruction, based on manifold decision forest technique. The use of this technique can be justified by noting that a specific type of shape variations might be governed by only a small number of parameters, and therefore can be well represented in a low-dimensional manifold. The key contributions of this work are the use of random decision forests for the shape manifold learning and robust metric for calculation of the re-projection error. The learned manifold defines constraints imposed on the reconstructed shapes. Due to a nonlinear structure of the learned manifold, this approach is more suitable to deal with large and complex object deformations when compared to the linear constraints. The robust metric is applied to reduce the effect of measurement outliers on the quality of the reconstruction. In many practical applications outliers cannot be completely removed and therefore the use of robust techniques is of particular practical interest. The proposed method is validated on 2D points sequences projected from the 3D motion capture data for ground truth comparison and also on real 2D video sequences. Experiments show that the newly proposed method provides better performance compared to previously proposed ones, including the robustness with respect to measurement noise, missing measurements and outliers present in the data.

Citation

Matuszewski, B. J., Tao, L., & Matuszewski, B. (2016). Robust deformable shape reconstruction from monocular video with manifold forests. Machine Vision and Applications, 27(6), 801-819. https://doi.org/10.1007/s00138-016-0769-3

Journal Article Type Article
Acceptance Date Apr 20, 2016
Online Publication Date May 19, 2016
Publication Date Aug 1, 2016
Deposit Date Apr 10, 2018
Publicly Available Date Apr 10, 2018
Journal Machine Vision and Applications
Print ISSN 0932-8092
Electronic ISSN 1432-1769
Publisher Springer Verlag
Peer Reviewed Peer Reviewed
Volume 27
Issue 6
Pages 801-819
DOI https://doi.org/10.1007/s00138-016-0769-3
Keywords deformable shape reconstruction, nonlinear manifold learning, manifold forests, missing data and outliers
Public URL https://uwe-repository.worktribe.com/output/908789
Publisher URL http://dx.doi.org/10.1007/s00138-016-0769-3

Files







Downloadable Citations