Introduction
Mastering and understanding human faces generally encompasses a variety of different research challenges. We investigate novel approaches to acquire and represent human faces, and to develop algorithms that enable stunning visual effects and even medical applications.
Topics
Geometry Acquisition & Reconstruction
Capturing and reconstructing the shape of the human face with very high spatial resolution and fidelity is an essential part of our research. We are currently focusing on purely passive systems. Our current system is a scalable single-shot scanner that consists of off-the-shelf consumer cameras.
Eye Capture
The human eye is one of the central features of individual appearance. To faithfully reproduce all its intricacies we propose a novel capture system that is capable of accurately reconstructing all the visible parts of the eye: the white sclera, the transparent cornea and the non-rigidly deforming colored iris.
Representations and Models
The demand for light weight facial performance capture requires developing new ways to represent and model the human face. Our anatomical-constrained face model can capture extreme deformation of the face from smartphone camera input.
Performance Capture and Tracking
The shape of the human face changes due to speech and facial expressions. Capturing and tracking the dynamic shape of the face in very high detail is challenging, due to the rapid and drastic changes the face undergoes. We developed a method to capture a dynamic performance with high fidelity using video cameras.
Synthesis and Augmentation
The synthesis of realistic human faces prevails throughout the entertainment industry, from virtual characters in films to real-world animatronics. Many motion capture and animation techniques can only produce low-resolution animation, lacking dynamic fine-scale detail. We developed techniques to enrich these low resolution sequences using an expressive model captured from and for each actors.
Publications
2020
P. Chandran, D. Bradley, M. Gross, T. Beeler
Semantic Deep Face Models
To appear: Proceedings of the International Conference on 3D Vision (Virtual, November 25-27, 2020)
Available files:
[
PDF] [
Abstract]
G. Zoss, E. Sifakis, M. Gross, T. Beeler, D. Bradley
Data-driven Extraction and Composition of Secondary Dynamics in Facial Performance Capture
Proceedings of ACM SIGGRAPH (Washington, D.C., USA, July 19th - 23rd, 2020), ACM Transactions on Graphics, vol. 39, no. 4, pp. 107:1-107:10
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
A. Gruber, M. Fratarcangeli, G. Zoss, R. Cattaneo, T. Beeler, M. Gross, D. Bradley
Interactive Sculpting of Digital Faces Using an Anatomical Modeling Paradigm
Proceedings of the Symposium on Geometry Processing (Utrecht, The Netherlands, July 6th - 8th, 2020), Computer Graphics Forum, vol. 39, no. 5, 2020, pp. 93-102
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
M. Fratarcangeli, D. Bradley, A. Gruber, G. Zoss, T. Beeler
Fast Nonlinear Least Squares Optimization of Large-Scale Semi-Sparse Problems
Proceedings of Eurographics (Norrköping, Sweden, May 25th - 29th, 2020), Computer Graphics Forum, vol. 39, no. 2, pp. 247-259
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
2019
G. Zoss, T. Beeler, M. Gross, D. Bradley
Accurate Markerless Jaw Tracking for Facial Performance Capture
Proceedings of ACM SIGGRAPH (Los Angeles,USA, July 28 - August 1st, 2019), ACM Transactions on Graphics, vol. 38, no. 4, pp. 50:1-50:8
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
P. Bérard, D. Bradley, M. Gross, T. Beeler
Practical Person-Specific Eye Rigging
Proceedings of Eurographics (Genova,Italy,, May 6-10, 2019), Computer Graphics Forum, vol. 38, no. 2, pp. 441-454
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
L. Shiming, M. Srinivasan, R. Mörzinger, M. Lancelle, T. Beeler, M. Gross, B. Solenthaler, V. Fehmer, I. Sailer
Reliability of a three-dimensional facial camera for dental and medical applications: A pilot study
Journal of Prosthetic Dentistry, Elsevier, 2019.
Available files:
[
PDF] [
Abstract]
2018
G. Zoss, D. Bradley, P. Bérard, T. Beeler
An Empirical Rig for Jaw Animation
Proceedings of ACM SIGGRAPH (Vancouver, Canada, August 12th - 16th, 2018), ACM Transactions on Graphics, vol. 37, no. 4, pp. 59:1-59:12
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
2017
Y. Kozlov, D. Bradley, M. Bächer, B. Thomaszewski, T. Beeler, M. Gross
Enriching Facial Blendshape Rigs with Physical Simulation
Proceedings of Eurographics (Lyon,France,, April 24-28, 2017), Computer Graphics Forum, vol. 36, no. 2, pp. 75-84
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
2016
P. Bérard, D. Bradley, M. Gross, T. Beeler
Lightweight Eye Capture Using a Parametric Model
Proceedings of ACM SIGGRAPH (Annaheim, USA, July 24-28, 2016), ACM Transactions on Graphics, vol. 35, no. 4, pp. 117:1--117:12
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
H. J. Kim, A. C. Oztireli, I. K. Shin, M. Gross, S. M. Choi
Interactive Generation of Realistic Facial Wrinkles from Sketchy Drawings
Proceedings of Eurographics (Zurich, Switzerland,, May 4-8, 2015), Computer Graphics Forum, vol. 34, no. 2, pp. 179-191
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
2014
P. Bérard, D. Bradley, M. Nitti, T. Beeler, M. Gross
High-Quality Capture of Eyes
Proceedings of ACM SIGGRAPH Asia (Shenzhen, China, December 3-6, 2014), ACM Transactions on Graphics, vol. 33, no. 6, pp. 223:1--223:12
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
A. H. Bermano, D. Bradley, T. Beeler, F. Zünd, D. Nowrouzezahrai, I. Baran, O. Sorkine-Hornung, H. Pfister, R. W. Sumner, B. Bickel, M. Gross
Facial Performance Enhancement Using Dynamic Shape Space Analysis
Proceedings of ACM SIGGRAPH 2014 (Vancouver, Canada, August 10-14, 2014), pp. 13:1--13:12
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
C. Kuster, J.C. Bazin, T. Deng, C. Oztireli, T. Martin, T. Popa, M. Gross
Spatio-Temporal Geometry Fusion for Multiple Hybrid Cameras using Moving Least Squares Surfaces
Proceedings of Eurographics (Strasbourg, France, April 7-11, 2014), Computer Graphics Forum, vol. 33, no. 2, pp. 1-10
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
T. Beeler, B. Bickel, G. Noris, S. Marschner, P. Beardsley, R. Sumner, M. Gross
Coupled 3D Reconstruction of Sparse Facial Hair and Skin
Proceedings of ACM SIGGRAPH (Los Angeles, USA, August 5-9, 2012), ACM Transactions on Graphics, vol. 31, no. 4, pp. 117:1-117:10
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
B. Bickel, P. Kaufmann, M. Skouras, B. Thomaszewski, D. Bradley, T. Beeler, P. Jackson, S. Marschner, W. Matusik, M. Gross
Physical Face Cloning
Proceedings of ACM SIGGRAPH (Los Angeles, USA, August 5-9, 2012), ACM Transactions on Graphics, vol. 31, no. 4, pp. 118:1-118:10
Available files:
[
PDF] [
Video] [
Abstract]
2011
T. Beeler, F. Hahn, D. Bradley, B. Bickel, P. Beardsley, C. Gotsman, M. Gross
High-quality passive facial performance capture using anchor frames
Proceedings of ACM SIGGRAPH (Vancouver, Canada, August 7-11, 2011), ACM Transactions on Graphics, vol. 30, no. 4, pp. 75:1-75:10
Available files:
[
PDF] [
Video] [
Video] [
Video] [
Video] [
BibTeX]
[
Abstract]
2010
D. Bradley, W. Heidrich, T. Popa, A. Sheffer
High Resolution Passive Facial Performance Capture
Proceedings of ACM SIGGRAPH (Los Angeles, USA, July 25-29, 2010), ACM Transactions on Graphics, vol. 29, no. 3, pp. 41:1--41:10
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]
T. Beeler, B. Bickel, P. Beardsley, R. Sumner, M. Gross
High-Quality Single-Shot Capture of Facial Geometry
Proceedings of ACM SIGGRAPH (Los Angeles, USA, July 25-29, 2010), ACM Transactions on Graphics, vol. 29, no. 3, pp. 40:1-40:9
Available files:
[
PDF] [
Video] [
BibTeX]
[
Abstract]