Vision and Control Techniques for Robotic Visual Tracking - Robotics Institute Carnegie Mellon University

Vision and Control Techniques for Robotic Visual Tracking

N. Papanikolopoulos, Pradeep Khosla, and Takeo Kanade
Conference Paper, Proceedings of (ICRA) International Conference on Robotics and Automation, Vol. 1, pp. 857 - 864, April, 1991

Abstract

Algorithms for robotic real-time visual tracking of arbitrary 3-D objects traveling at unknown velocities in a 2-D space are presented. The problem of visual tracking is formulated as a problem of combining control with computer vision. A mathematical formulation that is general enough to be extended to the problem of tracking 3-D objects in 3-D space is presented. The authors propose the use of sum-of-squared differences optical flow for the computation of the vector of discrete displacements each instant of time. These displacements can be fed either directly to a PI controller, a pole assignment controller, or a discrete steady-state Kalman filter. In the latter case, the Kalman filter calculates the estimated values of the system's states and exogenous disturbances, and a discrete LQG controller computes the desired motion of the robotic system. The outputs of the controllers are sent to a Cartesian robotic controller that drives the robot.

BibTeX

@conference{Papanikolopoulos-1991-13233,
author = {N. Papanikolopoulos and Pradeep Khosla and Takeo Kanade},
title = {Vision and Control Techniques for Robotic Visual Tracking},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {1991},
month = {April},
volume = {1},
pages = {857 - 864},
}