Computer Graphics Laboratory

How to Refine 3D Hand Pose Estimation from Unlabelled Depth Data ?

E. Dibra, T. Wolf, C. Öztireli, M. Gross

Proceedings of the Fifth International Conference on 3D Vision, 3DV (Qingdao, China, October 10-12, 2017), pp. 135-144

Abstract

Data-driven approaches for hand pose estimation from depth images usually require a substantial amount of labelled training data which is quite hard to obtain. In this work, we show how a simple convolutional neural network, pre-trained only on synthetic depth images generated from a single 3D hand model, can be trained to adapt to unlabelled depth images from a real user’s hand. We validate our method on two existing and a new dataset that we capture, both quantitatively and qualitatively, demonstrating that we strongly compare to state-of-the-art methods. Additionally, this method can be seen as an extension to existing methods trained on limited datasets, which helps on boosting their performance on new ones.


Downloads

Download Paper
[PDF]
Download Paper
[PDF suppl.]
Download Video
[Video]
Download Paper
[BibTeX]