filename     : Wu16b.pdf
entry        : article
conference   : SIGGRAPH Asia 2016, Macao, China, 5-8 December, 2016
pages        : 220:1--220:13
year         : 2016
month        : December
title        : Model-Based Teeth Reconstruction
subtitle     :
author       : Wu, Chenglei and Bradley, Derek and Garrido, Pablo and Zollhöfer, Michael and Theobalt, Christian and Gross, Markus and Beeler, Thabo
booktitle    : ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2016
ISSN/ISBN    : 978-1-4503-4514-9/16/12
editor       : 
publisher    : ACM
publ.place   : New York, NY, USA
volume       : -
issue        : -
language     : english
keywords     : Reconstruction, Shape modelling
abstract     : In recent years, sophisticated image-based reconstruction methods for the human face have been developed. These methods capture highly detailed static and dynamic geometry of the whole face, or specific models of face regions, such as hair, eyes or eye lids. Unfortunately, image-based methods to capture the mouth cavity in general, and the teeth in particular, have received very little attention. The accurate rendering of teeth, however, is crucial for the realistic display of facial expressions, and currently high quality face animations resort to tooth row models created by tedious manual work. In dentistry, special intra-oral scanners for teeth were developed, but they are invasive, expensive, cumbersome to use, and not readily available. In this paper, we therefore present the first approach for non-invasive reconstruction of an entire person-specific tooth row from just a sparse set of photographs of the mouth region. The basis of our approach is a new parametric tooth row prior learned from high quality dental scans. A new model-based reconstruction approach fits teeth to the photographs such that visible teeth are accurately matched and occluded teeth plausibly synthesized. Our approach seamlessly integrates into photogrammetric multi-camera reconstruction setups for entire faces, but also enables high quality teeth modeling from normal uncalibrated photographs and even short videos captured with a mobile phone.