Computer Graphics Laboratory ETH Zurich

ETH

Fin Textures for Real-Time Painterly Aesthetics

N. Imhof, A. Milliez, F. Jenal, R. Bauer, M. Gross, R. W. Sumner

MIG '15 Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games (Paris, France, November 16-18, 2015), pp. 227-235
[Abstract] [BibTeX] [PDF] [Video]

Abstract

We present a novel method for real-time stylized rendering in video games. Recent advances in painterly character authoring and rendering allow artists to create characters represented by 3D geometry as well as 3D paint strokes embedded on and around that geometry. The resulting 3D paintings are rendered in screen space using special-purpose offline rendering algorithms to achieve a unique painterly style. While providing novel styles for offline rendering, existing techniques do not support real-time applications. In this paper, we propose a method to interactively render these complex 3D paintings with a focus on character animation in video games. After observing that off-surface paint strokes can be interpreted as volumetric data in the proximity of 3D meshes, we review existing volumetric texture techniques and show that they are not adapted to paint strokes, which can be sparse and have a significant structure that should be preserved. We propose a method based fin textures in which mesh edges are extended orthogonally off the surface and textured to replicate the results of the custom offline rendering method. Our algorithm uses a per-pixel normal calculation in order to fade in fin textures along boundary views. Our results demonstrate real-time performance using a commodity game engine while maintaining a painterly style comparable to offline methods.

[Download Video]

@inproceedings{Imhof:2015:FTR:2822013.2822021,
author = {Imhof, Nicolas and Milliez, Antoine and Jenal, Flurin and Bauer, Ren{\'e} and Gross, Markus and Sumner, Robert W.},
title = {Fin Textures for Real-time Painterly Aesthetics},
booktitle = {Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games},
series = {MIG '15},
year = {2015},
isbn = {978-1-4503-3991-9},
location = {Paris, France},
pages = {227--235},
numpages = {9},
url = {http://doi.acm.org/10.1145/2822013.2822021},
doi = {10.1145/2822013.2822021},
acmid = {2822021},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {non-photorealistic rendering, painterly rendering, real-time rendering, stylization},
}
[Download BibTeX]

Downloads

Download Paper
[PDF]
Download Video
[Video]