filename : Baz16a.pdf entry : article conference : Proceedings of the Pacific Conference on Computer Graphics and Applications, Okinawa, Japan, October 11-14, 2016 pages : 421-429 year : 2016 month : October title : Physically Based Video Editing subtitle : author : Bazin, Jean-Charles and (Kuster), Claudia Plüss and Yu, Guo and Martin, Tobias and Jacobson, Alec and Gross, Markus booktitle : Computer Graphics Forum ISSN/ISBN : 1467-8659 editor : publisher : The Eurographics Association and John Wiley & Sons Ltd. publ.place : volume : 35 issue : 7 language : English keywords : abstract : Convincing manipulation of objects in live action videos is a difficult and often tedious task. Skilled video editors achieve this with the help of modern professional tools, but complex motions might still lack physical realism since existing tools do not consider the laws of physics. On the other hand, physically based simulation promises a high degree of realism, but typically creates a virtual 3D scene animation rather than returning an edited version of an input live action video. We propose a framework that combines video editing and physics-based simulation. Our tool assists unskilled users in editing an input image or video while respecting the laws of physics and also leveraging the image content. We first fit a physically based simulation that approximates the object's motion in the input video. We then allow the user to edit the physical parameters of the object, generating a new physical behavior for it. The core of our work is the formulation of an image-aware constraint within physics simulations. This constraint manifests as external control forces to guide the object in a way that encourages proper texturing at every frame, yet producing physically plausible motions. We demonstrate the generality of our method on a variety of physical interactions: rigid motion, multi-body collisions, clothes and elastic bodies.