Automatic target recognition and tracking in FLIR imagery using extended maximum average correlation height filter and polynomial distance classifier correlation filter (Invited Paper)

Abstract

Over the last two decades, researchers investigated various approaches for detection and classification of targets in forward looking infrared (FLIR) imagery using correlation based techniques. In this paper, a novel technique is proposed to recognize and track single as well as multiple identical and/or dissimilar targets in real life FLIR sequences using a combination of extended maximum average correlation height (EMACH) and polynomial distance classifier correlation filter (PDCCF). The EMACH filters are used for the detection stage and PDCCF filter is used for the classification stage for improving the detection and discrimination capability. The EMACH and PDCCF filters are trained a priori using target images with expected size and orientation variations. In the first step, the input scene is correlated with all the detection filters (one for each desired or expected target class) and the resulting correlation outputs are combined. The regions of interest (ROI) are selected from the input scene based on the regions with higher correlation peak values in the combined correlation output. In the second step, PDCCF filter is applied to these ROIs to identify target types and reject clutters/backgrounds based on a distance measure and a threshold. Moving target detection and tracking is accomplished by applying this technique independently to all incoming image frames. Independent tracking of target(s) from one frame to the other allows the system to handle complicated situations such as a target disappearing in few frames and then reappearing in later frames. This method has been found to yield robust performance for challenging FLIR imagery in terms of faster and accurate detection and classification as well as tracking of the targets.