Computer Graphics Laboratory ETH Zurich

ETH

High Resolution Passive Facial Performance Capture

D. Bradley, W. Heidrich, T. Popa, A. Sheffer

Proceedings of ACM SIGGRAPH (Los Angeles, USA, July 25-29, 2010), ACM Transactions on Graphics, vol. 29, no. 3, pp. 41:1--41:10
[Abstract] [BibTeX] [PDF] [Video]

Abstract

We introduce a purely passive facial capture approach that uses only an array of video cameras, but requires no template facial geometry, no special makeup or markers, and no active lighting. We obtain initial geometry using multi-view stereo, and then use a novel approach for automatically tracking texture detail across the frames. As a result, we obtain a high-resolution sequence of compatibly triangulated and parameterized meshes. The resulting sequence can be rendered with dynamically captured textures, while also consistently applying texture changes such as virtual makeup.

[Download Video]

@article{Bra10,
    title = {High Resolution Passive Facial Performance Capture},
    author = {Derek Bradley and Wolfgang Heidrich and Tiberiu Popa and Alla Sheffer},
    journal = {ACM Trans. on Graphics (Proc. SIGGRAPH)},
    number = {3},
    volume = {29},
    year = {2010}
}
[Download BibTeX]

Downloads

Download Paper
[PDF]
Download Video
[Video]