filename : Wu16b.pdf entry : article conference : SIGGRAPH Asia 2016, Macao, China, 5-8 December, 2016 pages : 220:1--220:13 year : 2016 month : December title : Model-Based Teeth Reconstruction subtitle : author : Wu, Chenglei and Bradley, Derek and Garrido, Pablo and Zollhöfer, Michael and Theobalt, Christian and Gross, Markus and Beeler, Thabo booktitle : ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2016 ISSN/ISBN : 978-1-4503-4514-9/16/12 editor : publisher : ACM publ.place : New York, NY, USA volume : - issue : - language : english keywords : Reconstruction, Shape modelling abstract : In recent years, sophisticated image-based reconstruction methods for the human face have been developed. These methods capture highly detailed static and dynamic geometry of the whole face, or specific models of face regions, such as hair, eyes or eye lids. Unfortunately, image-based methods to capture the mouth cavity in general, and the teeth in particular, have received very little attention. The accurate rendering of teeth, however, is crucial for the realistic display of facial expressions, and currently high quality face animations resort to tooth row models created by tedious manual work. In dentistry, special intra-oral scanners for teeth were developed, but they are invasive, expensive, cumbersome to use, and not readily available. In this paper, we therefore present the first approach for non-invasive reconstruction of an entire person-specific tooth row from just a sparse set of photographs of the mouth region. The basis of our approach is a new parametric tooth row prior learned from high quality dental scans. A new model-based reconstruction approach fits teeth to the photographs such that visible teeth are accurately matched and occluded teeth plausibly synthesized. Our approach seamlessly integrates into photogrammetric multi-camera reconstruction setups for entire faces, but also enables high quality teeth modeling from normal uncalibrated photographs and even short videos captured with a mobile phone.