[1]杨 戈,刘 宏.视觉跟踪算法综述[J].智能系统学报,2010,5(2):95-105.
　YANG Ge,LIU Hong.Survey of visual tracking algorithms[J].CAAI Transactions on Intelligent Systems,2010,5(2):95-105.
点击复制

视觉跟踪算法综述

《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷: 5 期数: 2010年第2期 页码: 95-105 栏目: 综述 出版日期: 2010-04-25
Title:
Survey of visual tracking algorithms
文章编号:
1673-4785(2010)02-0095-11
作者:
杨 戈，刘 宏
1.北京大学 深圳研究生院 集成微系统科学工程与应用重点实验室，广东 深圳 518055；
2.北京大学 机器感知与智能教育部重点实验室，北京100871
Author(s):
YANG Ge, LIU Hong
1. Key Laboratory of Integrated Microsystems, Shenzhen Graduate School of Peking University, Shenzhen 518055，China；
?2. Key Laboratory of Machine Perception, Peking University, Beijing 100871，China
关键词:
计算机视觉; 视觉跟踪; 粒子滤波; 均值漂移
Keywords:
computer vision; visual tracking; particle filter; mean shift
分类号:
TP
文献标志码:
A
摘要:
随着信息技术与智能科学的迅速发展，计算机视觉已经成为IT产业和高新技术领域的前沿.视觉跟踪是当前计算机视觉领域的热点问题之一.阐述了视觉跟踪算法的研究现状，包括视觉跟踪算法的种类，常用数学方法，研究了基于区域的跟踪算法、基于模型的跟踪算法、基于特征的跟踪算法、基于主动轮廓的跟踪算法、参数估计方法和无参密度估计方法，并探讨了视觉跟踪算法的未来研究方向. 
Abstract:
Progress in information technology and intelligent systems has brought computer vision to the forefront of IT research. Visual tracking is currently one of the most active research topics in computer vision. The state of research in visual tracking algorithms was examined for this paper. The authors reviewed the common visual tracking algorithms and their main mathematical methods. The examination included regionbased tracking algorithms, active contourbased tracking algorithms, featurebased tracking algorithms, modelbased tracking algorithms, parameter estimate algorithms and nonparameter density estimate algorithms. Significant issues needing further study were then discussed. 
参考文献/References:
［1］WANG Liang, HU Weiming, TAN Tieniu. Recent developments in human motion analysis［J］. Pattern Recognition, 2003,36(3):585601.
［2］YILMAZ P, JAVED O, SHAH M. Object tracking: a survey［J］. ACM Computing Surveys (CSUR), 2006，38(4):145.
［3］HU Weiming, TAN Tieniu, WANG Liang, MAYBANK S. A survey on visual surveillance of object motion and behaviors［J］. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 2004，34(3): 334352.
［4］HARIHARAKRISHNAN K, SCHONFELD D. Fast object tracking using adaptive block matching［J］. IEEE Transactions on Multimedia, 2005, 7(5): 853859.
?［5］LI Shan, LEE M C. Fast visual tracking using motion saliency in video［C］//IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP 2007). Honolulu, USA， 2007:10731076.
?［6］WREN C R, AZARBAYEJANI A, DARREL L, PENTLAND A P. Pfinder: realtime tracking of the human body［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence，1997, 19(7): 780785.
［7］YUAN Xiaotong，YANG Shutang，ZHU Hongwen. Region tracking via HMMF in joint featurespatial space［C］//IEEE Workshop on Motion and Video Computing. (WACV/MOTIONS ’05). Breckenridge, CO, USA，2005: 7277.
［8］NICKELS K, HUTCHINSON S. Modelbased tracking of complex articulated objects［J］. IEEE Transactions on Robotics and Automation，2001, 17(1): 2836.
?［9］LIN W C, LIU Yanxi. A latticebased MRF model for dynamic nearregular texture tracking［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007，29(5): 777792
［10］JANG D, CHOI H. Moving object tracking using active models［C］//International Conference on Image Processing(ICIP 98). Chicago,USA，1998: 648652.
［11］WEN Zhen, HUANG T S. Enhanced 3D geometricmodelbased face tracking in low resolution with appearance model［C］//IEEE International Conference on Image Processing(ICIP 2005). Genoa, Italy，2005: 350353.
［12］DOCKSTADER S L, TEKALP A M. Multiview spatial integration and tracking with Bayesian networks［C］//International Conference on Image Processing. Thessaloniki，2001:630633.
［13］WU Wen, CHEN Xilin, YANG Jie. Detection of text on road signs from video［J］. IEEE Transactions on Intelligent Transportation Systems, 2005, 6(4): 378390.
［14］SAEEDI P, LAWRENCE P D, LOWE D G. Visionbased 3D trajectory tracking for unknown environments［J］. IEEE Transactions on Robotics, 2006, 22(1): 119136.
［15】CHEN Zhichao, BIRCHFIELD S T. Person following with a mobile robot using binocular featurebased tracking［C］//IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS 2007). San Diego, 2007: 815820.
［16］李培华，张田文. 主动轮廓线模型(蛇模型)综述［J］. 软件学报，2000, 11(6): 751757. LI Peihua, ZHANG Tianwen. Review on active contour model［J］. Journal of Software, 2000, 11(6): 751757
［17］史 立, 张兆扬, 马 然. 基于运动跟踪匹配技术的视频对象提取［J］. 通信学报, 2001, 22(11): 7785. SHI Li, ZHANG Zhaoyang, MA Ran. Extraction of video object based on object tracking and matching［J］.Journal of China Institute of Communications, 2001, 22(11): 7785.
［18］NIETHAMMER M, TANNENBAUM A, ANGENENT S. Dynamic active contours for visual tracking［J］. IEEE Transactions on Automatic Control, 2006, 51(4): 562579.
［19］KASS M, WITKIN A, TERZOPOULUS D. Snakes: active contour models［J］. International Journal of Computer Vision, 1987, 1:321331.
【20】CHAN M T. Automatic lip model extraction for constrained contourbased tracking［C］// International Conference on Image Processing(ICIP 99). Kobe， 1999: 848851.
［21］PETERFREUND N. Robust tracking of position and velocity with Kalman snakes［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence，1999, 21(6): 564569.
［22］TANG Jinshan, ACTON S T. Boundary tracking for intravital microscopy via multiscale gradient vector flow snakes［J］. IEEE Transactions on Biomedical Engineering，2004, 51(2): 316324.
［23］SCHOEPFLIN T, CHALANA V, HAYNOR D R, KIM Y. Video object tracking with a sequential hierarchy of template deformations［J］. IEEE Transactions on Circuits and Systems for Video Technology，2001，11(11): 11711182.
［24］FU Yue，ERDEM A T, TEKALP A M. Tracking visible boundary of objects using occlusion adaptive motion snake［J］. IEEE Transactions on Image Processing，2000，9(12): 20512060.
［25］Le GUYADER C, VESE L A. Selfrepelling snakes for topologypreserving segmentation models［J］. IEEE Transactions on Image Processing, 2008, 17(5): 767779
［26］OZERTEM U, ERDOGMUS D. Nonparametric snakes［J］. IEEE Transactions on Image Processing, 2007, 16(9): 23612368.
［27］OZERTEM U, ERDOGMUS D. A nonparametric approach for active contours［C］//International Joint Conference on Neural Networks(IJCNN 2007).Orlando, USA， 2007: 14071410.
［28］ABDALMAGEED W, SMITH C E, RAMADAN S. Kernel snakes: nonparametric active contour models［C］//IEEE International Conference on Systems, Man， and Cybernetics. Washington, USA，2003: 240244.
［29］LEROY B, HERLIN I, COHEN L D. Multiresolution algorithms for active contour models［C］//12th International Conference on Analysis and Optimization System. Paris，France，1996: 5865.
［30】COHEN L D, COHEN I. Finite element methods for active contour models and baloons for 2D and 3D images［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1993, 15(11):11371147.
［31］ABRANTES A J, MARQUES J S. A class of constrained clustering algorithms for object boundary extraction［J］. IEEE Transactions on Image Process，1996，5(11): 15071521. 
［32］DAVATZIKOS C, PRINCE J L. An active contour model for mapping the cortex［J］. IEEE Transactions on Medical Imaging, 1995，14(1): 6580. 
［33］COHEN L D. On active contour models and balloons［J］. CVGIP: Image Understand，1991，53: 211218.
［34］XU C，PRINCE P L. Snakes, shapes and gradient vector flow［J］. IEEE Transactions on Image Process，1998，7(3): 359369.
［35］KALMAN R E. A new approach to linear filtering and prediction problems［J］. Journal of Basic Engineering (ASME)，1960，82D: 3545.
?［36］ANTONIOU C, AKIVA M B，KOUTSOPOULOS H N. Online calibration of traffic prediction models［C］//IEEE Intelligent Transportation Systems Conference. Washington, USA，2004: 8287.
?［37］ANTONIOU C, BENAKIVA M, KOUTSOPOULOS H N. Nonlinear Kalman filtering algorithms for online　calibration of dynamic traffic assignment models［J］. IEEE Transactions on Intelligent Transportation Systems, 2007, 8(4): 661670.
［38］SCHLOSSER M S, KROSCHEL K. Limits in tracking with extended Kalman filters［J］. IEEE Transactions on Aerospace and Electronic Systems, 2004, 40(4):13511359.
［39］BITTANTI S, SAVARESI S M. On the parametrization and design of an extended Kalman filter frequency tracker［J］. IEEE Transactions on Automatic Control, 2000, 45(9): 17181724.
［40］PERALA T, PICHE R. Robust extended Kalman filtering in hybrid positioning applications［C］//4th Workshop on Positioning, Navigation and Communication(WPNC ’07). Hannover, Germany， 2007: 5563.
［41］WU Xuedong, JIANG Xinhua, ZHENG Rongjin, HUANG Jiashan. An application of unscented Kalman filter for pose and motion estimation based on monocular vision［C］//IEEE International Symposium on Industrial Electronics. Montreal, Canada，2006: 26142619.
［42】JIANG Zhe, SONG Qi, HE Yuqing, HAN Jianda. A novel adaptive unscented Kalman filter for nonlinear estimation［C］//IEEE Conference on Decision and Control. New Orleans, USA，2007: 42934298.
?［43］AKIN B, ORGUNER U, ERSAK A. State estimation of induction motor using unscented Kalman filter［C］//IEEE Conference on Control Applications(CCA 2003). Istanbul, Turkey，2003: 915919.
?［44】VIDAL F B, ALCALDE V H C. Windowmatching techniques with Kalman filtering for an improved object visual tracking［C］//IEEE International Conference on Automation Science and Engineering(CASE 2007). Scottsdale, USA， 2007: 829834.
［45］COMANICIU D, MEER P. Mean shift analysis and applications［C］//The Proceedings of the Seventh IEEE International Conference on Computer Vision. Kerkyra，Greeke, 1999: 11971203.
 ［46］CHENG Yizong. Mean shift, mode seekiong, and clustering［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 17(8): 790799. 
［47］AVIDAN S. Ensemble tracking［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(2): 261271. 
［48］COMANICIU D, RAMESH V, MEER P. Kernelbased object tracking［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(5): 564577. 
?［49］COMANICIU D, RAMESH V, MEER P. Realtime tracking of nonrigid objects using mean shift［C］//IEEE Conference on Computer Vision and Pattern Recognition. Hilton Head Island, SC，2000: 142149. 
?［50］LIANG Dawei, HUANG Qingming, JIANG Shuqiang, YAO Hongxun, GAO Wen. Meanshift blob tracking with adaptive feature selection and scale adaptation［C］//IEEE International Conference on Image Processing. San Antonio, USA，2007: 369372. 
［51］YAO Anbang, WANG Guijin, LIN Xinggang, WANG Hao. Kernel based articulated object tracking with scale adaptation and model update［C］//IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2008). Las Vegas, USA，2008: 945948.
［52］GORDON N J, SALMOND D J, SMITH A F M. Novel approach to nonlinear/nonGaussian Bayesian state estimation［J］. IEEE Proceedings Radar and Signal Processing，1993，140(2): 107113.
［53］CHEN Z. Bayesian filtering: from Kalman filters to particle filters, and beyond. Manuscript［EB/OL］. ［20090103］.http://www.math.ubordeaux1.fr/~delmoral/chen_bayesian.pdf.
［54］DOUC R, CAPPE O. Comparison of resampling schemes for particle filtering［C］//Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis(ISPA 2005). Zagreb, Croatia，2005: 6469.
［55］HOL J D, SCHON T B, GUSTAFSSON F. On resampling algorithms for particle filters［C］//IEEE Nonlinear Statistical Signal Processing Workshop. Cambridge, UK，2006: 7982.
?［56］HONG Sangjin, DJURIC P M. Highthroughput scalable parallel resampling mechanism for effective redistribution of particles［J］. IEEE Transactions on Signal Processing, 2006, 54(3): 11441155.
［57］HONG Sangjin, BOLIC M, DJURIC P M. An efficient fixedpoint implementation of residual resampling scheme for highspeed particle filters［J］. IEEE Signal Processing Letters, 2004, 11(5): 482485.
［58］HEINE K. Unified framework for sampling/importance resampling algorithms［C］//8th International Conference on Information Fusion. Philadelphia, USA，2005: 14591464
［59】BOLIC M, DJURIC P M, HONG Sangjin. Resampling algorithms and architectures for distributed particle filters［J］. IEEE Transactions on Signal Processing, 2005, 53(7): 24422450.
［60］MARRON M, GARCIA J C, SOTELO M A, FERNANDEZ D, PIZARRO D. “XPFCP”: an extended particle filter for tracking multiple and dynamic objects in complex environments［C］//IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS 2005). Edmonton, Alberta, Canada，2005: 24742479.
［61］LI Jin, YU Hong, ZHOU Lulu, LIANG Hong, WANG Lei. An adaptive unscented particle filter tracking algorithm based on color distribution and wavelet moment［C］//Industrial 2nd IEEE Conference on Electronics and Applications(ICIEA 2007). Harbin, China，2007: 22182223.
?［62］RUI Yong, CHEN Yunqiang. Better proposal distributions: object tracking using unscented particle filter［C］//IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR 2001). Hawaii，USA，2001: 786793. ［63］CHANG W Y, CHEN C S, JIAN Y D. Visual tracking in highdimensional state space by appearanceguided particle filtering［J］.IEEE Transactions on Image Processing, 2008, 17(7): 11541167.
［64］SHAOHUA K Z, CHELLAPPA R, MOGHADDAM B. Visual tracking and recognition using appearanceadaptivemodels in particle filters［J］. IEEE Transactions on Image Processing, 2004, 13(11): 14911506.
［65］SANKARANARAYANAN A C, SRIVASTAVA A, CHELLAPPA R. Algorithmic and architectural optimizations for computationally efficient particle filtering［J］. IEEE Transactions on Image Processing, 2008, 17(5): 737748.
［66］MAGGIO E E, TAJ M M, CAVALLARO A A. Efficient multitarget visual tracking using random finite sets［J］. IEEE Transactions on Circuits and Systems for Video Technology, 2008, 18(8): 111.
［67］CEVHER V, SANKARANARAYANAN A C, MCCLELLAN J H, CHELLAPPA R. Target tracking using a joint acoustic video system［J］. IEEE Transactions on Multimedia，2007，9(4): 715727.
［68］XU Xinyu, LI Baoxin. Adaptive NaoBlackwellized particle filter and its evaluation for tracking in surveillance［J］. IEEE Transactions on Image Processing, 2007, 16(3): 838849.
相似文献/References:
[1]夏 凡,王 宏.基于局部异常行为检测的欺骗识别研究[J].智能系统学报,2007,2(5):12.
　XIA Fan,WANG Hong.Methodologies for deception detection based on abnormal b ehavior[J].CAAI Transactions on Intelligent Systems,2007,2():12.
[2]刘宏,李哲媛,许超.视错觉现象的分类和研究进展[J].智能系统学报,2011,6(1):1.
　LIU Hong,LI Zheyuan,XU Chao.The categories and research advances of visual illusions[J].CAAI Transactions on Intelligent Systems,2011,6():1.
[3]韩华,丁永生,郝矿荣.综合颜色和小波纹理特征的免疫粒子滤波视觉跟踪[J].智能系统学报,2011,6(4):289.
　HAN Hua,DING Yongsheng,HAO Kuangrong.An immune particle filter video tracking method based on color and wavelet texture[J].CAAI Transactions on Intelligent Systems,2011,6():289.
[4]叶果,程洪,赵洋.电影中吸烟活动识别[J].智能系统学报,2011,6(5):440.
　YE Guo,CHENG Hong,ZHAO Yang.moking recognition in movies[J].CAAI Transactions on Intelligent Systems,2011,6():440.
[5]史晓鹏,何为,韩力群.采用Hough变换的道路边界检测算法[J].智能系统学报,2012,7(1):81.
　SHI Xiaopeng,HE Wei,HAN Liqun.A road edge detection algorithm based on the Hough transform[J].CAAI Transactions on Intelligent Systems,2012,7():81.
[6]顾照鹏,刘宏.单目视觉同步定位与地图创建方法综述[J].智能系统学报,2015,10(4):499.[doi:10.3969/j.issn.1673-4785.201503003]
　GU Zhaopeng,LIU Hong.A survey of monocular simultaneous localization and mapping[J].CAAI Transactions on Intelligent Systems,2015,10():499.[doi:10.3969/j.issn.1673-4785.201503003]
[7]赵军,於俊,汪增福.基于改进逆向运动学的人体运动跟踪[J].智能系统学报,2015,10(4):548.[doi:10.3969/j.issn.1673-4785.201403032]
　ZHAO Jun,YU Jun,WANG Zengfu.Human motion tracking based on an improved inverse kinematics[J].CAAI Transactions on Intelligent Systems,2015,10():548.[doi:10.3969/j.issn.1673-4785.201403032]
[8]姬晓飞,王昌汇,王扬扬.分层结构的双人交互行为识别方法[J].智能系统学报,2015,10(6):893.[doi:10.11992/tis.201505006]
　JI Xiaofei,WANG Changhui,WANG Yangyang.Human interaction behavior-recognition method based on hierarchical structure[J].CAAI Transactions on Intelligent Systems,2015,10():893.[doi:10.11992/tis.201505006]
[9]方鹏,李贤,汪增福.运用核聚类和偏最小二乘回归的歌唱声音转换[J].智能系统学报,2016,11(1):55.[doi:10.11992/tis.201506022]
　FANG Peng,LI Xian,WANG Zengfu.Conversion of singing voice based on kernel clustering and partial least squares regression[J].CAAI Transactions on Intelligent Systems,2016,11():55.[doi:10.11992/tis.201506022]
[10]李雪,蒋树强.智能交互的物体识别增量学习技术综述[J].智能系统学报,2017,12(2):140.[doi:10.11992/tis.201701006]
　LI Xue,JIANG Shuqiang.Incremental learning and object recognition system based on intelligent HCI: a survey[J].CAAI Transactions on Intelligent Systems,2017,12():140.[doi:10.11992/tis.201701006]

备注/Memo

收稿日期：2009-11-15.
基金项目：
国家“863”计划资助项目（2006AA04Z247）；
国家自然科学基金资助项目(60675025，60875050)；
广东省自然科学基金资助项目（9151806001000025）；
深圳市科技计划项目及基础研究计划资助项目（JC200903160369A）.
通信作者：杨 戈.E-mail：yangge@szpku.edu.cn.
作者简介：
杨 戈，男，1974年生，博士，中国人工智能学会青年工作委员会会员，主要研究方向为视觉跟踪、视觉注意.发表学术论文20余篇，被SCI、EI检索11篇.
?刘 宏，男，1967年生，教授，博士生导师，IEEE 会员，国际机器人足球联盟(FIRA)竞赛委员会委员，中国人工智能学会常务理事、副秘书长、青年工作委员会主任，中国自动化学会智能自动化专业委员会委员，主要研究方向为模式识别、智能信息处理与计算机视觉.发表学术论文 60 余篇，其中 30 篇论文进入 SCI、EI 检索.

更新日期/Last Update: 2010-05-24
Copyright © 《 智能系统学报》 编辑部
地址：（150001）黑龙江省哈尔滨市南岗区南通大街145-1号楼 电话：0451- 82534001、82518134　邮箱：tis@vip.sina.com