Computer Graphics Laboratory

High Resolution Passive Facial Performance Capture

D. Bradley, W. Heidrich, T. Popa, A. Sheffer

Proceedings of ACM SIGGRAPH (Los Angeles, USA, July 25-29, 2010), ACM Transactions on Graphics, vol. 29, no. 3, pp. 41:1--41:10

Abstract

We introduce a purely passive facial capture approach that uses only an array of video cameras, but requires no template facial geometry, no special makeup or markers, and no active lighting. We obtain initial geometry using multi-view stereo, and then use a novel approach for automatically tracking texture detail across the frames. As a result, we obtain a high-resolution sequence of compatibly triangulated and parameterized meshes. The resulting sequence can be rendered with dynamically captured textures, while also consistently applying texture changes such as virtual makeup.


Downloads

Download Paper
[PDF]
Download Video
[Video]
Download Paper
[BibTeX]