Ship Recognition using Optical Imagery for Harbor Surveillance

Abstract

Many military and homeland defense missions require automated situation awareness in maritime environments. A major element of these missions is automatic detection, tracking, and recognition of ships as they transit harbors; optical sensors are important for these ATR tasks. GDRS is developing maritime optical ATR systems, incorporating a new capability for recognition of known ships, using a database of previously acquired imagery. The approach investigated uses the local interest point detector and descriptor known as SIFT (Scale Invariant Feature Transform) features. The SIFT interest point detector locates extrema in scale space of Difference-of-Gaussian functions, generating a set of distinctive image regions; the keypoint descriptor measures the orientation of local gradients in the region. The features are normalized, making them invariant to image scaling and rotation and partially invariant to changes in illumination and viewpoint. SIFT features are used in object recognition by matching features extracted from test images with those previously measured in database images. Following feature matching, a geometric verification process is used to eliminate false matches. This paper describes criteria developed to recognize ships with SIFT features and strategies used to handle changes in camera viewpoint and cluttered backgrounds common in maritime environments.