[1]孙海宇,陈秀宏,肖汉雄.联合外形响应的深度目标追踪器[J].智能系统学报,2019,14(4):725-732.[doi:10.11992/tis.201807029]
SUN Haiyu,CHEN Xiuhong,XIAO Hanxiong.A deep object tracker with outline response map[J].CAAI Transactions on Intelligent Systems,2019,14(4):725-732.[doi:10.11992/tis.201807029]
点击复制
SUN Haiyu,CHEN Xiuhong,XIAO Hanxiong.A deep object tracker with outline response map[J].CAAI Transactions on Intelligent Systems,2019,14(4):725-732.[doi:10.11992/tis.201807029]
联合外形响应的深度目标追踪器
《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷:
14
期数:
2019年第4期
页码:
725-732
栏目:
学术论文—人工智能基础
出版日期:
2019-07-02
- Title:
- A deep object tracker with outline response map
- Keywords:
- object tracking; neural network; convolutional features; correlation filter; position response; outline information; noise suppression; rectify; deep learning
- 分类号:
- TP391
- 摘要:
- 针对追踪器使用卷积网络提取出来的特征模板进行目标位置匹配时，易产生响应噪声的问题，本文提出一种联合外形响应和卷积响应的深度目标追踪方法。在当前帧中，由前一帧提供的目标信息先分别提取卷积特征和外形信息，然后获得相应的卷积位置响应和外形位置响应；最后利用外形位置响应对卷积位置响应进行修正，从而有效地抑制响应噪声。实验表明：这种方法具有较高的位置精度，能够提高目标跟踪的准确性。
- Abstract:
- When convolutional neural network is used as a template to locate target, noise may be unavoidable in the final location response. To solve this problem, we developed a deep object tracker by combining the convolutional position response with the outline position response. For example, in the current frame, after extracting convolutional features and the outline information from the predicted target in the previous frame, we obtained the corresponding convolutional position response and the outline position response, and the latter was used to rectify the former in controlling the noise generated in the convolutional position response. The favorable results of our deep tracker on the benchmark show that the method of integrating the outline position response into the convolutional position response can greatly improve the precision and accuracy of the tracker.
- 参考文献/References:
-
[1] WU Yi, LIM J, YANG M H. Online object tracking:a benchmark[C]//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA, 2013:2411-2418.
[2] 杨戈, 刘宏. 视觉跟踪算法综述[J]. 智能系统学报, 2010, 5(2):95-105 YANG Ge, LIU Hong. Survey of visual tracking algorithms[J]. CAAI transactions on intelligent systems, 2010, 5(2):95-105
[3] WU Yi, LIM J, YANG M H. Object tracking benchmark[J]. IEEE transactions on pattern analysis and machine intelligence, 2015, 37(9):1834-1848.
[4] 管皓, 薛向阳, 安志勇. 深度学习在视频目标跟踪中的应用进展与展望[J]. 自动化学报, 2016, 42(6):834-847 GUAN Hao, XUE Xiangyang, AN Zhiyong. Advances on application of deep learning for video object tracking[J]. Acta automatica sinica, 2016, 42(6):834-847
[5] HENRIQUES J F, CASEIRO R, MARTINS P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE transactions on pattern analysis and machine intelligence, 2015, 37(3):583-596.
[6] DANELLJAN M, H?GER G, KHAN F S, et al. Discriminative scale space tracking[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 39(8):1561-1575.
[7] HENRIQUES J F, CASEIRO R, MARTINS P, et al. Exploiting the circulant structure of tracking-by-detection with kernels[C]//Proceedings of the 12th European Conference on Computer Vision. Florence, Italy, 2012:702-715.
[8] BERTINETTO L, VALMADRE J, GOLODETZ S, et al. Staple:complementary learners for real-time tracking[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA, 2016:1401-1409.
[9] LI Yang, ZHU Jianke. A scale adaptive kernel correlation filter tracker with feature integration[C]//Proceedings of European Conference on Computer Vision. Zurich, Switzerland, 2014:254-265.
[10] ALOM M Z, TAHA T M, YAKOPCIC C, et al. The history began from alexNet:a comprehensive survey on deep learning approaches[J] arXiv:1803.01164, 2018.
[11] WANG Naiyan, YEUNG D Y. Learning a deep compact image representation for visual tracking[C]//Proceedings of the 26th International Conference on Neural Information Processing Systems. Lake Tahoe, USA, 2013:809-817.
[12] BERTINETTO L, VALMADRE J, HENRIQUES J F, et al. Fully-convolutional Siamese networks for object tracking[C]//Proceedings of European Conference on Computer Vision. Amsterdam, The Netherlands, 2016:850-865.
[13] VALMADRE J, BERTINETTO L, HENRIQUES J, et al. End-to-end representation learning for correlation filter based tracking[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA, 2017:5000-5008.
[14] GUO Qing, FENG Wei, ZHOU Ce, et al. Learning dynamic Siamese network for visual object tracking[C]//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy, 2017:1781-1789.
[15] LI Bo, YAN Junjie, WU Wei, et al. High performance visual tracking with Siamese region proposal network[C]//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA, 2018:8971-8980.
[16] ZHU Zheng, WANG Qiang, LI Bo, et al. Distractor-aware Siamese networks for visual object tracking[C]//Proceedings of European Conference on Computer Vision. Munich, Germany, 2018:103-119.
[17] DONG Xingping, SHEN Jianbing. Triplet loss in Siamese network for object tracking[C]//Proceedings of the 15th European Conference on Computer Vision. Munich, Germany, 2018:472-488.
[18] BOLME D S, BEVERIDGE J R, DRAPER B A, et al. Visual object tracking using adaptive correlation filters[C]//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. California, USA, 2010:2544-2550.
[19] DANELLJAN M, H?GER G, KHAN F S, et al. Accurate scale estimation for robust visual tracking[C]//Proceedings of the 25th British Machine Vision Conference. Link?ping, Sweden, 2014:1-5
[20] CANNY J. A computational approach to edge detection[J]. IEEE transactions on pattern analysis and machine intelligence, 1986, PAMI-8(6):679-698.
[21] DALAL N, TRIGGS B. Histograms of oriented gradients for human detection[C]//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. California, USA, 2005:886-893.
[22] DERICHE R. Using Canny’s criteria to derive a recursively implemented optimal edge detector[J]. International journal of computer vision, 1987, 1(2):167-187.
[23] ELDER J H, ZUCKER S W. Local scale control for edge detection and blur estimation[J]. IEEE transactions on pattern analysis and machine intelligence, 1998, 20(7):699-716.
[24] OLSHAUSEN B A, FIELD D J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images[J]. Nature, 1996, 381(6583):607-609.
[25] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe, USA, 2012:1097-1105.
[26] BLEIHOLDER J, NAUMANN F. Data fusion[J]. ACM computing surveys (CSUR), 2009, 41(1):1.
[27] KALMAN R E. A new approach to linear filtering and prediction problems[J]. Journal of basic engineering, 1960, 82(1):35-45.
[28] FELZENSZWALB P F, GIRSHICK R B, MCALLESTER D, et al. Object detection with discriminatively trained part-based models[J]. IEEE transactions on pattern analysis and machine intelligence, 2010, 32(9):1627-1645.
[29] RUSSAKOVSKY O, DENG Jia, SU Hao, et al. Imagenet large scale visual recognition challenge[J]. International journal of computer vision, 2015, 115(3):211-252.
[30] ABADI M, BARHAM P, CHEN Jianmin, et al. Tensorflow:a system for large-scale machine learning[C]//Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation. Savannah, USA, 2016:265-283.
[31] CHOI J, CHANG H J, YUN S, et al. Attentional correlation filter network for adaptive visual tracking[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA, 2017:4828-4837.
[32] ZHANG Jianming, MA Shugao, SCLAROFF S. MEEM:robust tracking via multiple experts using entropy minimization[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland, 2014:188-203.
[33] MA Chao, YANG Xiaokang, ZHANG Chongyang, et al. Long-term correlation tracking[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA, 2015:5388-5396.
[34] SUN H. Y data[EB/OL]. https://github.com/SMZCC/A_proposed_deep_tracker.
- 相似文献/References:
-
[1]丁永生.计算智能的新框架：生物网络结构[J].智能系统学报,2007,2(2):26.
DING Yong-sheng.A new scheme for computational intelligence: bio-network architecture[J].CAAI Transactions on Intelligent Systems,2007,2():26.
[2]徐 雄.人工情感的进化控制系统实现[J].智能系统学报,2008,3(2):135.
XU Xiong.Implementation of an evolutionary control system based on artificial emotion[J].CAAI Transactions on Intelligent Systems,2008,3():135.
[3]周孔丹,李 宁,鲁华祥.单电子电路的鲁棒性研究[J].智能系统学报,2008,3(3):195.
ZHOU Kong-dan,LI Ning,LU Hua-xiang.Researching the robustness of single electron devices[J].CAAI Transactions on Intelligent Systems,2008,3():195.
[4]张米娜,韩红桂,乔俊飞.前馈神经网络结构动态增长-修剪方法[J].智能系统学报,2011,6(2):101.
ZHANG Mina,HAN Honggui,QIAO Junfei.Research on dynamic feedforward neural network structure based on growing and pruning methods[J].CAAI Transactions on Intelligent Systems,2011,6():101.
[5]张文辉,高九州,马静,等.漂浮基空间机器人的径向基神经网络鲁棒自适应控制[J].智能系统学报,2011,6(2):114.
ZHANG Wenhui,GAO Jiuzhou,MA Jing,et al.The RBF neural network robust adaptive control of a freefloating space robot[J].CAAI Transactions on Intelligent Systems,2011,6():114.
[6]薄迎春,乔俊飞,杨刚.一种多模块协同参与的神经网络[J].智能系统学报,2011,6(3):225.
BO Yingchun,QIAO Junfei,YANG Gang.A multimodule cooperative neural network[J].CAAI Transactions on Intelligent Systems,2011,6():225.
[7]蒲兴成,张军,张毅.基于神经网络的改进行为协调控制及其在智能轮椅路径规划中的应用[J].智能系统学报,2011,6(5):456.
PU Xingcheng,ZHANG Jun,ZHANG Yi.Modified behavior coordination for intelligent wheelchair path planning based on a neural network[J].CAAI Transactions on Intelligent Systems,2011,6():456.
[8]段海庆,朱齐丹.基于反步自适应神经网络的船舶航迹控制[J].智能系统学报,2012,7(3):259.
DUAN Haiqing,ZHU Qidan.Trajectory tracking control of ships based onan adaptive backstepping neural network[J].CAAI Transactions on Intelligent Systems,2012,7():259.
[9]乔俊飞,逄泽芳,韩红桂.基于改进粒子群算法的污水处理过程神经网络优化控制[J].智能系统学报,2012,7(5):429.
QIAO Junfei,PANG Zefang,HAN Honggui.Neural network optimal control for wastewater treatment processbased on APSO[J].CAAI Transactions on Intelligent Systems,2012,7():429.
[10]郭一,刘金琨.带执行器饱和的柔性关节机器人位置反馈动态面控制[J].智能系统学报,2013,8(1):21.[doi:10.3969/j.issn.1673-4785.201204012]
GUO Yi,LIU Jinkun.Position feedback dynamic surface control for flexible joint robots with actuator saturation[J].CAAI Transactions on Intelligent Systems,2013,8():21.[doi:10.3969/j.issn.1673-4785.201204012]
备注/Memo
收稿日期:2018-07-26。
基金项目:江苏省研究生科研与实践创新计划项目（1232050205185680）
作者简介:孙海宇,男,1993年生,硕士研究生,主要研究方向为图像处理、目标跟踪、深度学习相关算法;陈秀宏,男,1964年生,教授,博士后,主要研究方向为数字图像处理和模式识别、目标检测与跟踪、优化理论与方法。发表学术论文100余篇;肖汉雄,男,1991年生,硕士研究生,主要研究方向为模式识别和数字图像处理、人脸识别、深度学习相关算法。
通讯作者:孙海宇.E-mail:6161610009@vip.jiangnan.edu.cn
更新日期/Last Update:
2019-08-25