Computer Graphics Laboratory ETH Zurich

ETH

Practical Temporal Consistency for Image-based Graphics Applications

M. Lang, O. Wang, T. Aydin, A. Smolic, M. Gross

Proceedings of ACM SIGGRAPH (Los Angeles,USA, August, 2012), ACM Transactions on Graphics, vol. 31, no. 4, pp. 34:1--34:8
[Abstract] [BibTeX] [PDF] [Video]

Abstract

We present an efficient and simple method for introducing temporal consistency to a large class of optimization driven image-based computer graphics problems. Our method extends recent work in edge-aware filtering, approximating costly global regularization with a fast iterative joint filtering operation. Using this representation, we can achieve tremendous efficiency gains both in terms of memory requirements and running time. This enables us to process entire shots at once, taking advantage of supporting information that exists across far away frames, something that is difficult with existing approaches due to the computational burden of video data. Our method is able to filter along motion paths using an iterative approach that simultaneously uses and estimates per-pixel optical flow vectors. We demonstrate its utility by creating temporally consistent results for a number of applications including optical flow, disparity estimation, colorization, scribble propagation, sparse data up-sampling, and visual saliency computation.

[Download Video]

@article{Lang:2012:PTC:2185520.2185530,
author = {Lang, Manuel and Wang, Oliver and Aydin, Tunc and Smolic, Aljoscha and Gross, Markus},
title = {Practical Temporal Consistency for Image-based Graphics Applications},
journal = {ACM Trans. Graph.},
issue_date = {July 2012},
volume = {31},
number = {4},
month = jul,
year = {2012},
issn = {0730-0301},
pages = {34:1--34:8},
articleno = {34},
numpages = {8},
url = {http://doi.acm.org/10.1145/2185520.2185530},
doi = {10.1145/2185520.2185530},
acmid = {2185530},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {filtering, optical flow, regularization, temporal coherence, video},
}
[Download BibTeX]

Downloads

Download Paper
[PDF]
Download Video
[Video]