High Resolution Passive Facial Performance Capture
D. Bradley, W. Heidrich, T. Popa, A. Sheffer
Proceedings of ACM SIGGRAPH (Los Angeles, USA, July 25-29, 2010), ACM Transactions on Graphics, vol. 29, no. 3, pp. 41:1--41:10
Abstract
We introduce a purely passive facial capture approach that uses only
an array of video cameras, but requires no template facial geometry,
no special makeup or markers, and no active lighting. We obtain
initial geometry using multi-view stereo, and then use a novel
approach for automatically tracking texture detail across the frames.
As a result, we obtain a high-resolution sequence of compatibly
triangulated and parameterized meshes. The resulting sequence can be
rendered with dynamically captured textures, while also consistently
applying texture changes such as virtual makeup.