OpenDR: An Approximate Differentiable Renderer - Robotics Institute Carnegie Mellon University
Loading Events

VASC Seminar

September

28
Mon
Matthew Loper Research Engineer Industrial Light and Magic
Monday, September 28
3:00 pm to 4:00 pm
OpenDR: An Approximate Differentiable Renderer

Event Location: NSH 1507
Bio: Matthew Loper is a research engineer at Industrial Light and Magic, and a PhD candidate at the University of Tuebingen. He received his ScM from Brown University in 2008. His current research interests include differentiable rendering and statistical body shape modeling.

Abstract: Inverse graphics attempts to take sensor data and infer 3D geometry, illumination, materials, and motions such that a graphics renderer could realistically reproduce the observed scene. Renderers, however, are designed to solve the forward process of image synthesis. To go in the other direction, we propose an approximate differentiable renderer (DR) that explicitly models the relationship between changes in model parameters and image observations. We describe a publicly available OpenDR framework that makes it easy to express a forward graphics model and then automatically obtain derivatives with respect to the model parameters and to optimize over them. Built on a new auto-differentiation package and OpenGL, OpenDR provides a local optimization method that can be incorporated into probabilistic programming frameworks. We demonstrate the power and simplicity of programming with OpenDR by using it to solve the problem of estimating human body shape from Kinect depth and RGB data.