- Research
- Open Access

# Robust L1 tracker with CNN features

- Hongqing Wang
^{1}and - Tingfa Xu
^{1}Email author

**2017**:194

https://doi.org/10.1186/s13638-017-0982-4

© The Author(s). 2017

**Received: **27 September 2017

**Accepted: **6 November 2017

**Published: **21 November 2017

## Abstract

Recently, L1 tracker has been widely applied and received great success in visual tracking. However, most L1 trackers use only the image intensity for sparse representation, which is insufficient to represent the object especially when drastic appearance changes occur. Convolutional neural network (CNN) has demonstrated remarkable capability in a wide range of computer vision fields, and features extracted from different convolutional layers have different characteristics. In this paper, we propose a novel sparse representation model with convolutional features for visual tracking. Besides, to alleviate the redundancy from high-dimensional convolutional features, a feature selection method is adopted to remove noisy and irrelevant feature maps, which can reduce computation redundancy and improve tracking accuracy. Different from traditional sparse representation based tracking methods, our model not only exploits convolutional features to improve the robustness for describing the object appearance but also uses the trivial templates to model both reconstruction errors caused by sparse representation and the eigen-subspace representation. In addition, an unified objective function is proposed and a customized APG method is developed to effectively solve the optimization problem. Numerous qualitative and quantitative evaluations demonstrate that our tracker outperforms other state-of-the-art trackers in a wide range of tracking scenarios.

## Keywords

- CNN features
- Visual tracking
- Sparse representation
- APG method

## 1 Introduction

Visual tracking plays an important role in computer vision and has received fast-growth attention in recent years due to its wide practical application such as pedestrian detection, vehicle navigation, security surveillance, and wireless communication [1–4]. In general, visual tracking is to track an interested target which usually has been indicated in the first frame by a bounding box in video streams. The main challenge of visual tracking is the numerous appearance changes, such as occlusion, abrupt motion, illumination variation, in-plane rotation, out-of-plane rotation, deformation, and scale variation.

To overcome the above challenges, many effective trackers have been proposed in recent years [5, 6]. Generally, tracking algorithms can be classified into three different categories: discriminative, generative, and hybrid generative-discriminative. Discriminative trackers formulate tracking as a binary classification problem, which search the target location and extract target from the background. The main problem of discriminative trackers is that they cannot estimate the target-specific location due to the limited number of candidates. Generative trackers adopt an appearance model to represent the target appearance, which estimate the target state by finding the highest likelihood; the model is often updated online to deal with the appearance changes. The main problem of generative trackers is that the appearance model often exhibits some limitations thus cannot represent the target effectively [7–9]. Hybrid generative-discriminative trackers fuse the advantages of discriminative and generative trackers; researchers have proposed many effective hybrid generative-discriminative trackers recently [10–13]. The hybrid model can take advantage of the global characteristics of object and also exploit the useful information from the background. However, the complexity of hybrid model is relatively high, which will lead to a high computational cost, thus cannot meet the requirement in practice.

Recently, as a generative tracking algorithm, sparse representation model has achieved outstanding performance [14]. Mei et al. [15] first propose the L1 tracker by casting the tracking problem as finding a sparse combination of a target template set and a trivial template set to approximate the target object. Then the sparsity is achieved by solving an *l*
_{1}-regularized least squares problem. Ji et al. [16] improve the tracking accuracy by adding an *l*
_{2} norm regularization on the trivial coefficients and use an accelerated proximal gradient approach for solving the minimization problem which has achieved both tracking accuracy and computational efficiency. Zhang et al. [17] exploit the intrinsic relationship among different candidates which utilize the joint-sparsity property of candidates by casting tracking as a multi-task problem. Jia et al. [18] exploit both partial information and spatial information of the target based on a novel alignment-pooling method and employ a template update strategy, which combines incremental subspace learning and sparse representation. Wang et al. [19] introduce *l*
_{1} regularization into the principal component analysis (PCA) reconstruction and propose an online tracking algorithm, which approximates the target by linearly combining the PCA basis and a sparse set of trivial templates. Liu et al. [20] use a local sparse representation for representing the target and exploit the sparse coding histogram to represent the dynamic dictionary basis distribution of the target model. Guo et al. [21] propose a novel multi-view structural local subspace method which jointly exploits the advantages of three sub-models and uses an alignment-weighting average method to obtain the optimal state of the target. Wang et al. [22] adopt squared templates to replace trivial templates to handle partial occlusion and propose a probabilistic collaborative representation framework, which reduces the complexity in traditional sparse model-based methods. Kim et al. [23] propose a novel structure-preserving sparse learning method, which preserves both local geometrical and discriminative structures within a multi-task feature selection framework.

However, most of these methods mainly aim at improving the tracking accuracy or efficiency, they usually use the image intensity to construct the template set, which is less effective in expressing the structural information of the target, thus cannot cover severe appearance changes of the target object.

To solve this problem, many hand-crafted features have been used for visual tracking, such as Haar-like features, histogram of oriented gradient (HOG) features, local binary pattern (LBP), and scale-invariant feature transform (SIFT). However, these hand-crafted features are not robust for generic object tracking. Convolutional neural network (CNN) models which learn hierarchical features from raw images on large-scale dataset have been widely used to represent the appearance of the target. Ma et al. [24] exploit the features from hierarchical layers of CNN within a correlation filter-based framework for visual tracking, learn linear correlation filters on each CNN layer, and adopt a coarse-to-fine method to estimate the target location. Wang et al. [25] analyze CNN features from different layers and use a novel tracking method which jointly exploits two convolutional layers to mitigate the drift problem. Danelljan et al. [26] indicate that activations from the first convolutional layers achieve favorable tracking performance compared with the deeper layers within a discriminative correlation filter-based framework. In contrast to the traditional feature descriptors, CNN features contain more structural information, which is crucial to localize the target in an unknown frame.

Motivated by the above observations, we present a novel L1 tracker with CNN features. The proposed approach use a novel sparse representation model with convolutional features for visual tracking, which not only exploits CNN features to improve the robustness for describing the object appearance but also uses the trivial templates to model both reconstruction errors caused by sparse representation and the eigen-subspace representation. Besides, to alleviate redundancy of high-dimensional convolutional features, a feature selection method is adopted, which can reduce computation complexity and improve tracking accuracy. This strategy makes the model jointly exploit the advantages of the CNN features with more structural information to effectively represent the target, and of both sparse representation and the incremental subspace learning simultaneously. In addition, a customized APG method is developed to effectively solve the optimization problem. Furthermore, a robust observation likelihood metric is proposed.

The rest of this paper is organized as follows. In Section 2, we introduce the CNN features and the proposed sparse model in detail. In Section 3, we demonstrate the optimization of the objective function and the overall tracking algorithm. In Section 4, we present the details of the quantitative and qualitative experiments of our method compared with the state-of-the-art methods. In Section 5, we reach the conclusions of this paper.

## 2 Proposed model

### 2.1 CNN features

Most of the traditional L1 trackers usually use the image intensity to construct the template set. However, the image intensity-based trackers can hardly handle the complicated situation in practical visual tracking due to the lack of target structural information. To this end, our algorithm introduces CNN features in describing the target template set.

Convolutional neural network (CNN) has been successfully applied in many computer vision fields, especially in complicated tasks such as object detection, image classification, and object recognition [27]. Traditional CNN, which only the information from the last layer are used to represent the target, are effective in dealing with classification problems. However, adopting CNN for generic visual tracking directly is inadequate due to the lack of training samples and the computational complexity.

To overcome this problem, pre-trained CNN feature extraction method is proposed in recent years. CNN features, extracted from different CNN layers, have different characteristics in describing the object [24]. The CNN features from deeper layer contains more high-level semantic information, which can be seen as structural information, have more distinguishing capabilities and thus is effective facing the situation when intra-class appearance variation occurs. However, the features from deep layer have very low spatial resolution so that it cannot fit the task in generic visual tracking, which aim to indicate the location of target. On the other hand, CNN features from earlier layer contain more fine-grained information, which means the more the discriminative capabilities, the more effective in locating the target. But with the less semantic information, features from earlier layer are more sensitive to intra-class appearance variations.

From the observation above, different from the common strategy which use CNN feature extracted from the last layer, we exploit CNN features from hierarchical layers in order to make full use of the high-level structural information as well as preserving the spatial information of target.

### 2.2 Feature selection

In this paper, we employ CNN features extracted from VGG Net [28], which is trained on the large-scale ImageNet dataset; note that other CNN models may also be used alternatively, such as AlexNet [29] and R-CNN [30].

VGG-19 Net (with 16 convolutional layers and 3 full connect layers) has more deep structure than other CNN models, which can provide more semantic information. Given an input image frame, due to the CNN pooling propagation, the spatial resolution of each layer is more and more smaller, for instance, pool1 with the size of 224 × 224 and pool5 with only the size of only 7 × 7. The target in small size layers is hard to tell, so there is a need to resize each layer as a fixed size in order to locate the target accurately.

*ω*

_{ ki }depends on the position of

*k*and

*i*neighboring feature vectors, and

*F*denotes the feature space.

As discussed above, in order to utilize CNN features from multi-layers, we choose conv2-2, conv3-4, and conv5-4 layers as feature representations specifically.

However, CNN features are pre-trained mainly aimed at dealing with classification tasks, so there are plenty of neurons used in describing generic object, which results in a very large number of wasted features. Here, by wasted features, we mean features which are redundant in discriminating target from background, especially when target deformation occurs. Furthermore, deeper CNN features are high-dimensional features (e.g., 512 dimension for conv5-4), leading to an extremely high computational complexity.

In order to alleviate the influences of these wasted features, it is of great importance to adopt an appropriate selection mechanism. From the experimental observation, we found that most redundant features have zero values for representing the target, so we adopt a sparse method to remove the redundancy similar to [25] and choose the feature with the largest coefficient as the template set.

### 2.3 Sparse representation model with CNN features and incremental subspace constraint

**z**∈

*ℝ*

^{ D }can be sparsely representated by target template set

**M**= [

**m**

_{1},

**m**

_{2}, …,

**m**

_{ N }] ∈

*ℝ*

^{ D × N }and the trivial template set

**I**∈

*ℝ*

^{ D × D }, where

*D*is the dimension of the observation vector,

*N*is the number of target templates, and

**I**is an identity matrix; traditional sparse representation-based trackers approximate target object by linearly combining

**M**and

**I**with sparse constraints,

**A**= [

**M**,

**I**],

**a**= [

**a**

_{ M },

**a**

_{ I }] ∈

*ℝ*

^{ D + N }indicates the corresponding sparse coefficients, and

*λ*controls the amount of regularization. The optimal state is the state with smallest reconstruction error.

However, traditional sparse representation-based trackers have some drawbacks. First, the computational complexity is relatively high which limit the real-time application. Secondly, they only use image intensity to construct the target template set, which can hardly handle the drastic appearance changes of target in practical visual tracking due to the lack of feature description. Thirdly, the target templates are only obtained from a previous couple of time instants, which cannot effectively obtain the underlying properties for modeling target appearance.

To solve the second problem, we use CNN features in describing the object. However, CNN features from different convolutional layers have different characteristics, high-level features have more distinguishing capabilities while low spatial resolution, and low-level features have more discriminative capabilities while sensitive to appearance changes. So, we construct a target template set by using hierarchical CNN features as a more complete feature descriptor. Furthermore, CNN features have a very high dimension in contrast to image intensity-based trackers, which results in an extreme computation complexity. In addition, most CNN features have barely contributed to effectively determine the exact location of the target, so we adopt a feature selection method to alleviate the redundancy.

To solve the third problem, an eigen template model is introduced for its ability to learn the temporal correlation of target appearances effectively from the past observation data by incremental update procedure, which compactly capture both rich and redundant image properties [33]. The incremental visual tracking (IVT) [34] algorithm can efficiently learn and update a low-dimensional PCA subspace representation of the target object and update the sample mean, which makes full use of the past observed target appearances. Experimental results have demonstrated that incremental learning of PCA subspace representation can deal with appearance changes caused by rotation, illumination variation, deformation and scale change efficiently. However, it has also been demonstrated that the performance of IVT tracker declines when partial occlusion occurs. Since the underlying assumption of PCA is that the error of each pixel is Gaussian distributed with small variances, this assumption does not hold anymore case of partial occlusion occurs. Furthermore, the IVT tracker may also fail when the target overlaps with a similar object.

*l*

_{1}regularization into the PCA reconstruction and modeling the error term

**e**with arbitrary but sparse noise,

**U**∈

*ℝ*

^{ D × P }is the PCA eigen basis matrix and

*P*is the number of eigen basis vectors.

**q**∈

*ℝ*

^{ P }are the coefficients of

**U**and

*τ*controls the amount of regularization.

**B**= [

**T**,

**I**],

**T**is the target template set with CNN features,

**c**= [

**c**

_{ T },

**c**

_{ I }] ∈

*ℝ*

^{3D + N }indicates the corresponding sparse coefficients, \( \overline{\mathbf{t}} \) is the sample mean of target object, and

*σ*balances the contribution of the two terms.

This strategy constrains the reconstruction of the sparse representation to have a minimal reconstruction error in the PCA eigen basis representation. Meaning that our model with incremental subspace constrains can model both reconstruction errors caused by sparse representation and the eigen-subspace representation. This method constructs the reliable part of the target using a few number of PCA basis.

The above overall model takes advantages of both the capability of hierarchical CNN features in describing the target and the subspace constrained sparse representation.

## 3 Optimization and the tracking algorithm

### 3.1 Optimization

*F*(

**c**) is a differentiable convex function with Lipschitz continuous gradient and

*G*(

**c**) is a non-smooth convex function. We describe the details of solution as follows.

**R**=

**T**−

**UU**

^{T}

**T**and \( \mathbf{S}=\overline{\mathbf{t}}-\mathbf{U}{\mathbf{U}}^{\mathrm{T}}\overline{\mathbf{t}} \). Then the problem (6-2) can be reformed to the following formulation:

However, APG method cannot be used directly in our model since the original APG method is proposed for solving unconstrained minimization problem, so there is a need to covert our model into an unconstrained problem.

_{ T }∈

*ℝ*

^{ N }denotes the column vector with entries are all 1. Let

*ψ*(

**c**) denotes the indicator function defined by

*k*denotes the current iteration time,

*L*is the Lipschitz constant and

*β*

_{ k + 1}is defined in Algorithm 1. We define

*g*

_{ k + 1}=

*β*

_{ k + 1}− ∇

*F*(

*β*

_{ k + 1})/

*L*and the soft-thresholding operator \( {\mathfrak{T}}_{\rho }(x)=\operatorname{sign}(x)\max \left(\left|x\right|-\rho, 0\right) \). Then, the fast numerical algorithm for solving problem (6-2) is given in Algorithm 1.

### 3.2 Particle filter tracking framework

**Z**

_{1 : t − 1}= [

**z**

_{1},

**z**

_{2}, …,

**z**

_{ t − 1}], the posterior probability can be recursively computed as

*p*(

**x**

_{ t }|

**x**

_{ t − 1}) is the dynamic model and

**x**

_{ t }indicates the state vector.

*t*, by using Bayes rule, we get

*p*(

**z**

_{ t }|

**x**

_{ t }) denotes the observation likelihood of observing

**z**

_{ t }at state

**x**

_{ t }. The state variable

**x**

_{ t }is composed of six parameters

**x**

_{ t }= [

*t*

_{ x },

*t*

_{ y },

*θ*

_{ t },

*s*

_{ t },

*δ*

_{ t },

*φ*

_{ t }]

^{T}, where

*t*

_{ x },

*t*

_{ y },

*θ*

_{ t },

*s*

_{ t },

*δ*

_{ t },

*φ*

_{ t }denote

*x*,

*y*translations, rotation angle, scale, aspect ratio, and skew respectively.

Through the above method, we generate the candidates state set \( {\mathbf{X}}_t=\left\{{\mathbf{x}}_t^1,{\mathbf{x}}_t^2,\dots, {\mathbf{x}}_t^n\right\} \), where *n* is the number of candidates sampled at each frame. For each particle \( {\mathbf{x}}_t^i \), we crop out the related image region to get \( {\mathbf{z}}_t^i \). Then, we get a candidate set \( {\mathbf{Z}}_t=\left[{\mathbf{z}}_t^1,{\mathbf{z}}_t^2,\dots, {\mathbf{z}}_t^n\right]\in {R}^{D\times n} \).

*φ*is a normal factor,

*δ*

_{1},

*δ*

_{2}, and

*δ*

_{3}balance the contributions between the three terms. The first term is the reconstruction error of the original image patch. The second term is the reconstruction error of sparse representation by target templates with CNN features. The third term reflects the relevancy between the reconstructed target and target PCA basis with CNN features. The optimal state \( {\mathbf{x}}_t^{\ast } \) of frame

*t*is achieved by

### 3.3 Template update

To alleviate the influences of object appearance changes, there is a need to update the target template and PCA basis dictionary dynamically.

First, we use the method proposed in [27] to update target template. This updating strategy can effectively alleviate the influences caused by noise and occlusion. However, the target template is achieved from a previous couple of time, so they are not capable of dealing with numerous appearance variations due to the lack of long-term adjustment.

Then, we update the PCA basis dictionary using the method proposed in [34] and replace the oldest target template with the PCA reconstruction of the optimal candidate when the estimated optimal state is achieved. The PCA eigen template model could learn the temporal correlation of object appearances by incremental SVD update procedure effectively, so it has the ability to cover a long period of appearance changes relatively.

By adopting the strategy proposed above, we co-update the target template and PCA basis for current target appearance and long-term adjustment to improve the performance of our tracker.

## 4 Experiments

In order to illustrate the performance of our tracker, we test the robustness of our algorithm on 12 challenging video sequences with other 9 state-of-the-art trackers. The trackers are L1APG [16], ASLA [18], MTT [36], LSK [37], SST [38], IVT [34], FRAG [39], KMS [40], and SRUCK [41].

The proposed algorithm in this paper is implemented in MATLAB 2014a on a PC with Intel i7-4790 CPU (3.6 GHz) and 16 GB RAM memory. Before the experiment, we adopt some parameters and modify them according to other cited published works. For example, the iteration number is set to be 5 in the optimization part, but the tracking performance improves little when it is set to 10 or other lager value and the computational cost also increases with the iteration number. We did many experiments to choose the best parameter values as follows. Each sample is resized to 24 × 24 pixels. The number of target templates is set to be 11 with one fixed template extracted from the first frame. The candidate number *n* in each frame is 600. These values mainly affect the speed of the tracker; we choose them to achieve a balance between the speed and the tracking performance. The number of PCA basis is set to be 10. The regularization factor *λ* is set to be 0.01, σ is set to be 0.1, and ρ is set to be 0.01. The balance factors *δ*
_{1}, *δ*
_{2}, and *δ*
_{3} are set to be 10, 10, and 1. The Lipschitz constant *L* is set to be 8.

### 4.1 Qualitative evaluation

Tracking sequences used in this paper

Sequences | Frame | Main problem |
---|---|---|

Deer | 71 | Motion blur, fast motion, background clutters |

David2 | 537 | Rotation |

Crossing | 120 | Deformation, background clutters, scale variation |

Boy | 602 | Scale variation, motion blur, rotation, fast motion |

David3 | 252 | Rotation, background clutters, deformation, occlusion |

FaceOcc1 | 892 | Occlusion |

Football | 362 | Background clutters, Rotation, Occlusion |

Walking | 412 | Low resolution, occlusion, scale variation, deformation |

Football1 | 74 | Rotation, background clutters |

Sylvester | 1345 | Illumination variation, rotation |

Subway | 175 | Occlusion, background clutters, deformation |

Mhyang | 1490 | Background clutters, deformation, illumination variation |

Compared with traditional sparse representation-based trackers (e.g., L1APG, MTT, ASLA, LSK, and SST), our tracker outperforms in a wide range of challenging scenarios, especially when occlusion, rotation, and deformation occurs. This mainly attributes to our tracker that exploits both the advantage of sparse representation and incremental subspace learning, as well as using CNN features for representing the target. The incremental learning of PCA subspace representation method mainly aims at dealing with appearance changes caused by rotation, deformation, and scale variation, but it is sensitive to occlusion. In our algorithm, the occluded pixels of target object can be represented by the trivial templates, so when partial occlusion occurs, our tracker is more robust than the IVT tracker. Traditional sparse representation-based trackers are sensitive to rotation and deformation because they only use the image intensity for representing the target, but our method adopts CNN features from hierarchical layers in order to make full use of the high-level structural information as well as preserving the spatial information of target, so our tracker is more robust than these traditional L1 trackers.

In conclusion, our tracker performs well in all the 12 sequences while other 9 state-of-the-art trackers fail in some sequences.

### 4.2 Quantitative evaluation

We provide quantitative comparisons of our tracker with other state-of-the-art methods in terms of center location error (CLE) and overlap rate (VOR). The CLE is measured by the Euclidean distance between the estimated target center location and the ground truth center location. The VOR is defined by \( \frac{\mathrm{area}\left({B}_T\cap {B}_{GT}\right)}{\mathrm{area}\left({B}_T\cup {B}_{GT}\right)} \), where *B*
_{
T
} is the estimated target bounding box and *B*
_{
GT
} is the ground truth bounding box.

In addition, we adopt the precision and success rate for evaluating the tracking performance. The precision criteria is the percentage of frames which estimated location is within a given threshold distance of the ground truth and the success criteria is the ratios of successful frames at a given threshold ranged from 0 to 1.

Note that in 6 of the 12 sequences (e.g., deer, david2, football1, mhyang, sylvester, and walking), the proposed tracker achieves the best average center error. In 7 of the 12 sequences (e.g., deer, crossing, david3, football1, mhyang, sylvester, and walking), the proposed tracker achieves the best overlap rate. In other sequences, our tracker achieves either the second or the third best scores. The proposed tracker also achieves both the best scores in average center error and average overlap rate for all the 12 sequences, meaning that our tracker outperforms other state-of-the-art trackers in many challenging situations significantly.

## 5 Conclusions

In this paper, we propose a robust L1 tracker with CNN features. Different from traditional sparse representation-based tracking algorithms, our model not only exploits convolutional features to improve the robustness for describing the object appearance but also uses the trivial templates to model both reconstruction errors caused by sparse representation and the eigen-subspace representation. A customized APG method is developed to solve the optimization problem effectively. Both qualitative and quantitative evaluations demonstrate that our tracker outperforms other state-of-the-art trackers in many challenging situations.

## Declarations

### Acknowledgements

The authors would like to thank Image Engineering & Video Technology Lab for the support.

### Funding

This work was supported by the Major Science Instrument Program of the National Natural Science Foundation of China under Grant 61527802, the General Program of National Nature Science Foundation of China under Grant 61371132 and 61471043, and the International S&T Cooperation Program of China under Grant 2014DFR10960.

### Authors’ contributions

HW and TX came up with the algorithm and improved the algorithm. HW wrote and revised the paper. Both authors read and approved the final manuscript.

### Competing interests

The authors declare that they have no competing interests.

### Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## Authors’ Affiliations

## References

- L Baroffio, A Canclini, MCA Redondi, M Tagliasacchi, G Dán, E Eriksson, V Fodor, J Ascenso, P Monteiro,
*Enabling Visual Analysis in Wireless Sensor Networks, IEEE International Conference on Image Processing*(2015), pp. 3408–3410Google Scholar - F Zhao, B Li, H Chen, X Lv, Joint beamforming and power allocation for cognitive MIMO systems under imperfect CSI based on game theory. Wirel. Pers. Commun.
**73**, 679–694 (2013)View ArticleGoogle Scholar - F Zhao, X Sun, H Chen, R Bie, Outage performance of relay-assisted primary and secondary transmissions in cognitive relay networks. EURASIP J. Wirel. Commun. Netw.
**2014**, 60 (2014)View ArticleGoogle Scholar - F Zhao, L Wei, H Chen, Optimal time allocation for wireless information and power transfer in wireless powered communication systems. IEEE Trans. Veh. Technol.
**65**, 1830–1835 (2016)View ArticleGoogle Scholar - A Yilmaz, O Javed, M Shah, Object tracking: a survey. ACM Comput. Surv.
**38**, 13 (2006)View ArticleGoogle Scholar - Y Wu, J Lim, MH Yang,
*Online Object Tracking: A Benchmark, IEEE Conference on Computer Vision and Pattern Recognition*(2013), pp. 2411–2418Google Scholar - H Yang, L Shao, F Zheng, L Wang, Z Song, Recent advances and trends in visual tracking: a review. Neurocomputing
**74**, 3823–3831 (2011)View ArticleGoogle Scholar - AW Smeulders, DM Chu, R Cucchiara, S Calderara, A Dehghan, M Shah, Visual tracking: an experimental survey. IEEE Trans. Pattern Anal. Mach. Intell.
**36**, 1442–1468 (2013)Google Scholar - X Li, W Hu, C Shen, Z Zhang, A Dick, AVD Hengel, A survey of appearance models in visual object tracking. ACM Trans. Intell. Syst. Technol.
**4**, 58 (2013)Google Scholar - Y Yin, X Wang, D Xu, F Liu, Y Wang, W Wu, Robust visual detection–learning–tracking framework for autonomous aerial refueling of UAVs. IEEE Trans. Instrum. Meas.
**65**, 510–521 (2016)View ArticleGoogle Scholar - W Zhong, H Lu, MH Yang, Robust object tracking via sparse collaborative appearance model. IEEE Trans. Image Process.
**23**, 2356–2368 (2014)MathSciNetView ArticleGoogle Scholar - Y Yin, D Xu, X Wang, M Bai, Online state-based structured SVM combined with incremental PCA for robust visual tracking. IEEE Trans. Cybern.
**45**, 1988–2000 (2017)Google Scholar - S Chen, S Li, R Ji, Y Yan, S Zhu, Discriminative local collaborative representation for online object tracking. Knowl.-Based Syst.
**100**, 13–24 (2016)View ArticleGoogle Scholar - S Zhang, H Yao, X Sun, X Lu, Sparse coding based visual tracking: review and experimental comparison. Pattern Recogn.
**46**, 1772–1788 (2013)View ArticleGoogle Scholar - X Mei, H Ling, Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell.
**33**, 2259 (2011)View ArticleGoogle Scholar - H Ji, H Ling, Y Wu, C Bao,
*Real Time Robust L1 Tracker Using Accelerated Proximal Gradient Approach, IEEE Conference on Computer Vision and Pattern Recognition*(2012), pp. 1830–1837Google Scholar - T. Zhang, B. Ghanem, S. Liu, N. Ahuja, Robust visual tracking via multi-task sparse learning, IEEE Conference on Computer Vision and Pattern Recognition. 157, 2042-2049 (2012).Google Scholar
- X Jia,
*Visual Tracking Via Adaptive Structural Local Sparse Appearance Model, IEEE Conference on Computer Vision and Pattern Recognition*(2012), pp. 1822–1829Google Scholar - D Wang, H Lu, MH Yang, Online object tracking with sparse prototypes. IEEE Trans. Image Process.
**22**, 314 (2013)MathSciNetView ArticleMATHGoogle Scholar - B Liu, J Huang, C Kulikowski, L Yang, Robust visual tracking using local sparse appearance model and K-selection. IEEE Trans. Pattern Anal. Mach. Intell.
**35**, 2968–2981 (2013)View ArticleGoogle Scholar - J Guo, T Xu, G Shi, Z Rao, X Li, Multi-view structural local subspace tracking. Sensors
**17**, 666 (2017)View ArticleGoogle Scholar - H Wang, S Zhang, Y Du, H Ge, B Hu, Visual tracking via probabilistic collaborative representation. J. Electron. Imaging
**26**, 013010 (2017)View ArticleGoogle Scholar - H Kim, S Jeon, S Lee, JK Paik,
*Robust Visual Tracking Using Structure-Preserving Sparse Learning, IEEE Signal Processing Letters, PP*(2017), pp. 1–1Google Scholar - C Ma, JB Huang, X Yang, MH Yang,
*Hierarchical Convolutional Features for Visual Tracking, IEEE International Conference on Computer Vision*(2016), pp. 3074–3082Google Scholar - L Wang, W Ouyang, X Wang, H Lu,
*Visual Tracking with Fully Convolutional Networks, IEEE International Conference on Computer Vision*(2016), pp. 3119–3127Google Scholar - M Danelljan, G Häger, FS Khan, M Felsberg,
*Convolutional Features for Correlation Filter Based Visual Tracking, IEEE International Conference on Computer Vision Workshop*(2015), pp. 621–629Google Scholar - Y Lecun, Y Bengio, G Hinton, Deep learning. Nature
**521**, 436–444 (2015)View ArticleGoogle Scholar - K. Simonyan, A. Zisserman, Very Deep Convolutional Networks for Large-Scale Image Recognition, Computer Science, (2014).Google Scholar
- A Krizhevsky, I Sutskever, GE Hinton,
*ImageNet Classification with Deep Convolutional Neural Networks, International Conference on Neural Information Processing Systems*(2012), pp. 1097–1105Google Scholar - R Girshick, J Donahue, T Darrell, J Malik,
*Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation, Computer Vision and Pattern Recognition*(2014), pp. 580–587Google Scholar - B Hariharan, P Arbeláez, R Girshick, J Malik,
*Hypercolumns for Object Segmentation and Fine-Grained Localization*(2014), pp. 447–456Google Scholar - X Mei, H Ling,
*Robust Visual Tracking Using L (1) Minimization, IEEE International Conference on Computer Vision*(2009), pp. 1436–1443Google Scholar - T Bai, YF Li, Robust visual tracking with structured sparse representation appearance model. Pattern Recogn.
**45**, 2390–2404 (2012)View ArticleMATHGoogle Scholar - DA Ross, J Lim, RS Lin, MH Yang, Incremental learning for robust visual tracking. Int. J. Comput. Vis.
**77**, 125–141 (2008)View ArticleGoogle Scholar - R Tibshirani, Regression shrinkage and selection via the lasso: a retrospective. J. R. Stat. Soc.
**73**, 267–288 (2011)MathSciNetView ArticleMATHGoogle Scholar - T Zhang, B Ghanem, S Liu, N Ahuja, Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vis.
**101**, 367–383 (2013)MathSciNetView ArticleGoogle Scholar - C Kulikowsk,
*Robust Tracking Using Local Sparse Appearance Model and K-Selection, IEEE Conference on Computer Vision and Pattern Recognition*(2011), pp. 1313–1320Google Scholar - T Zhang, S Liu, C Xu, Y Shuicheng, B Ghanem, N Ahuja, MH Yang,
*Structural Sparse Tracking, IEEE Conference on Computer Vision and Pattern Recognition*(2015), pp. 150–158Google Scholar - A Adam, E Rivlin, I Shimshoni,
*Robust Fragments-Based Tracking Using the Integral Histogram, Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference*(2006), pp. 798–805Google Scholar - D Comaniciu, V Ramesh, P Meer, Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell.
**25**, 564–575 (2003)View ArticleGoogle Scholar - S Hare, A Saffari, PHS Torr,
*Struck: Structured Output Tracking with Kernels, IEEE International Conference on Computer Vision*(2011), pp. 263–270Google Scholar