Scene flow is the three-dimensional motion field of points in the world, just as optical flow is the two-dimensional motion field of points in an image. Any optical flow is simply the projection of the scene flow onto the image plane of a camera. We have developed a framework for the computation of dense, non-rigid scene flow from optical flow. We have also developed an algorithm for computing 3D scene flow and 3D scene shape simultaneously. This second algorithm does not require the prior computation of optical flow. See the movie below for an example of a reconstructed 3D voxel model and the corresponding 3D scene flow. As the movie plays, the voxels in the 3D are “flowed” along the scene flow.
 |
Image shows video sequence. |
See our Spatio-Temporal View Interpolation algorithm for a better way of rendering such scenes across both space and time.
current staff
past head
- Simon Baker
past staff
- Robert Collins
- Arvind Lakshmikumar
- Peter Rander
- Steven Seitz
past contact
- Simon Baker