Figure 1. The overall framework of the proposed tracking algorithm.
| Donghun Yeo | Jeany Son | Bohyung Han | Joon Hee Han |
| POSTECH | |||
Figure 1. The overall framework of the proposed tracking algorithm.
We propose a simple but effective tracking-by-segmentation algorithm using Absorbing Markov Chain (AMC) on superpixel segmentation, where target state is estimated bya combination of bottom-up and top-down approaches, and target segmentation is propagated to subsequent frames in a recursive manner. Our algorithm constructs a graph for AMC using the superpixels identified in two consecutive frames, where background superpixels in the previous frame correspond to absorbing vertices while all other superpixels create transient ones. The weight of each edge depends on the similarity of scores in the end superpixels, which are learned by support vector regression. Once graph construction is completed, target segmentation is estimated using the absorption time of each superpixel. The proposed tracking algorithm achieves substantially improved performance compared to the state-of-the-art segmentation-based tracking techniques in multiple challenging datasets.
Results on tracking-by-segmentation
Tracking-by-segmentation aims to obtain segmentation masks given initial bounding box annotations at the first frame.
AMCT and AMCT+CNN are our full algorithms and AMCT-NR and AMCT-NA is the variations of ours.
Results on online semi-supervised video segmentation
Online semi-supervised video segmentation aims to propagate segmentation masks given initial segmentation annotations at the first frame.
This task is differentiated from our main problem, tracking-by-segmentation, which has bounding box annotations at the first frame.
Segmentation results on five datasets, non-rigid object tracking dataset (NR) [34], generalized background subtraction dataset (GBS) [22, 25, 24], video saliency dataset (VS) [11], SegTrack v2 dataset (ST2) [23], and DAVIS dataset [30].