[1]伍明,李广宇,魏振华,等.纯方位角目标跟踪及移动平台可观性控制方法[J].智能系统学报,2022,17(5):919-930.[doi:10.11992/tis.202107066]
　WU Ming,LI Guangyu,WEI Zhenhua,et al.Bearing only target tracking and observability control of a mobile robot[J].CAAI Transactions on Intelligent Systems,2022,17(5):919-930.[doi:10.11992/tis.202107066]
点击复制

纯方位角目标跟踪及移动平台可观性控制方法

《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷: 17 期数: 2022年第5期 页码: 919-930 栏目: 学术论文—机器学习 出版日期: 2022-09-05
Title:
Bearing only target tracking and observability control of a mobile robot
作者:
伍明1, 李广宇2, 魏振华1, 汪洪桥1
1. 西安高技术研究所 信息系统室，陕西 西安 710025;
2. 陕西广播电视大学 教学科，陕西 西安 710023
Author(s):
WU Ming1, LI Guangyu2, WEI Zhenhua1, WANG Hongqiao1
1. Information System Office, Xi’an High Technology Research Institute, Xi’an 710025, China;
2. Teaching Department, Shaanxi Radio and TV University, Xi’an 710023, China
关键词:
目标跟踪; 纯方位角观测; 机器人同时定位与地图构建; 机器人导航控制; 单目视觉导航; 可观性控制; 自主移动平台; 单目视觉
Keywords:
object tracking; bearing only observation; SLAM; robot navigation control; monocular visual navigation; observability control; autonomous mobile platform; monocular vision
分类号:
TP242.6
DOI:
10.11992/tis.202107066
文献标志码:
2022-08-01
摘要:
为了解决未知环境下的单目视觉移动机器人目标跟踪问题，提出了一种将目标状态估计与机器人可观性控制相结合的机器人同时定位、地图构建与目标跟踪方法。在状态估计方面，以机器人单目视觉同时定位与地图构建为基础，设计了扩展式卡尔曼滤波框架下的目标跟踪算法；在机器人可观性控制方面，设计了基于目标协方差阵更新最大化的优化控制方法。该方法能够实现机器人在单目视觉条件下对自身状态、环境状态、目标状态的同步估计以及目标跟随。仿真和原型样机实验验证了目标状态估计和机器人控制之间的耦合关系，证明了方法的准确性和有效性，结果表明：机器人将产生螺旋状机动运动轨迹，同时，目标跟踪和机器人定位精度与机器人机动能力成正比例关系。
Abstract:
To address the object tracking issue of a mobile robot based on monocular vision in an unknown environment, a method for robotic simultaneous localization, map building, and object tracking is proposed, combining the object state estimation with the observability control of a mobile robot. Regarding state estimation, based on robot monocular visual simultaneous localization and mapping, a target tracking algorithm under the extended Kalman filtering framework is designed. Considering the observability control, an optimal control method based on updating the maximization of the target covariance matrix is designed. Using the monocular vision, this method can synchronously estimate the robot’s own state, environmental state, and target state, as well as the target following. The simulation and prototype experiments verify the coupling relationship between the target state estimation and robot control, demonstrating the effectiveness and accuracy of the method. The results indicate that by employing this method, the robot can generate a spiral maneuvering trajectory, and the accuracy of target tracking and robot positioning is directly proportional to its maneuvering ability.
参考文献/References:
[1] 蔡自兴, 邹小兵. 移动机器人环境认知理论与技术的研究[J]. 机器人, 2004, 26(1): 87–91
CAI Zixing, ZOU Xiaobing. Research on environmental cognition theory and methodology for mobile robots[J]. Robot, 2004, 26(1): 87–91
[2] YANG Nan, WANG Rui, GAO Xiang, et al. Challenges in monocular visual odometry: photometric calibration, motion bias, and rolling shutter effect[J]. IEEE robotics and automation letters, 2018, 3(4): 2878–2885.
[3] WANG C C, THORPE C, THRUN S, et al. Simultaneous localization, mapping and moving object tracking[J]. The international journal of robotics research, 2007, 26(9): 889–916.
[4] 伍明, 李琳琳, 孙继银. 基于概率数据关联交互多模滤波的移动机器人未知环境下动态目标跟踪[J]. 机器人, 2012, 34(6): 668–679
WU Ming, LI Linlin, SUN Jiyin. PDA-IMM based moving object tracking with mobile robots in unknown environments[J]. Robot, 2012, 34(6): 668–679
[5] MUNARO M, LEWIS C, CHAMBERS D, et al. RGB-D human detection and tracking for industrial environments[M]//Intelligent Autonomous Systems 13. Cham: Springer International Publishing, 2015: 1655?1668.
[6] ZHANG Rui, WANG Zhaokui, ZHANG Yulin. Astronaut visual tracking of flying assistant robot in space station based on deep learning and probabilistic model[J]. International journal of aerospace engineering, 2018, 2018: 1–17.
[7] CASTLER O, MURRAYDW. Object recognition and localization while tracking and mapping[C]// Proceedings of 8th IEEE International Symposium on Mixed andAugmented Reality. Orlando, IEEE, 2009: 179?180.
[8] KLEIN G, MURRAY D. Parallel tracking and mapping for small AR workspaces[C]// Proceedings of6th IEEE and ACM International Symposium on Mixed and Augmented Reality. Nara, IEEE, 2007: 225?234.
[9] DE OLIVEIRA D CB, DE SOUZA DA SILVA R L. Moving object tracking for SLAM-based augmented reality[J]. Journalof mobile multimedia, 2021, 17(4): 577–602.
[10] DAI W, ZHANG Y, ZHENG Y, et al. RGB-D SLAM with moving object tracking in dynamic environments[J]. IET cyber-systems and robotics, 2021, 3(4): 11.
[11] LI Guihai, CHEN Songlin. Visual slam in dynamic scenes based on object tracking and static points detection[J]. Journal of intelligent & robotic systems, 2022, 104(2): 1–10.
[12] CIVERA J, DAVISON A J, MONTIEL J M M. Inverse depth parametrization for monocular SLAM[J]. IEEE transactions on robotics, 2008, 24(5): 932–945.
[13] DISSANAYAKE M W M G, NEWMAN P, CLARK S, et al. A solution to the simultaneous localization and map building (SLAM) problem[J]. IEEE transactions on robotics and automation, 2001, 17(3): 229–241.
[14] WANGSIRIPITAK S, MURRAY D W. Avoiding moving outliers in visual SLAM by tracking moving objects[C]// Proceedings of IEEE International Conference on Robotics and Automation. Kobe, IEEE, 2009: 375?380.
[15] MIGLIORE D, RIGAMONTI R, MARZORATI D, et al. Use a single camera for simultaneous localization and mapping with mobile object tracking in dynamic environments[C]//Proceedings of IEEE International Conference on Robotics and Automation, Kobe, Japan. IEEE, 2009: 889?895
[16] BESCOS B, CAMPOS C, TARDóS J D, et al. DynaSLAM II: tightly-coupled multi-object tracking and SLAM[J]. IEEE robotics and automation letters, 2021, 6(3): 5191–5198.
[17] LIU Yuzhen, LIU Jiacheng, HAO Yun, et al. A switching-coupled backend for simultaneous localization and dynamic object tracking[J]. IEEE robotics and automation letters, 2021, 6(2): 1296–1303.
[18] SUALEH M, KIM G W. Semantics aware dynamic SLAM based on 3D MODT[J]. Sensors (Basel, Switzerland), 2021, 21(19): 6355.
[19] LIU Jiacheng, MENG Ziyang, YOU Zheng. A robust visual SLAM system in dynamic man-made environments[J]. Science China technological sciences, 2020, 63(9): 1628–1636.
[20] OH R, SHIYifang, CHOI J W. A hybrid Newton-raphson and particle swarm optimization method for target motion analysis by batch processing[J]. Sensors (Basel, Switzerland), 2021, 21(6): 2033.
[21] ZHUK R S. Automatic detection and tracking the moving objects observed by an unmanned aerial vehicles video camera[J]. Informatics, 2021, 18(2): 83–97.
[22] WATANABE Y. Stochastically optimized monocular vision-based navigation and guidance[D]. USA: Georgia Institute of Technology, 2008: 57.
[23] KIM J, ROCK S. Stochastic feedback controller design considering the dual effect[J]//AIAA Guidance, Navigation, and Control Conference and Exhibit. Keystone, Colorado. Reston, Virginia: AIAA, 2006: 6090.
[24] SCH?LLERC, ARAVANTINOS V, LAY F, et al. What the constant velocity model can teach us about pedestrian motion prediction[J]. IEEE robotics and automation letters, 2020, 5(2): 1696–1703.
[25] ZHANG Z. A flexible new technique for camera calibration[J]. IEEE transactionson pattern analysis and machine intelligence, 2000, 22(11): 1330–1334.
[26] DAI Y, LEE S G. The leader-follower formation control of non-holonomic mobile robots[J]. International journal of control, automation and systems, 2012, 10(2): 350–361.
相似文献/References:
[1]王绍钰 蔡自兴,陈爱斌.改进的粒子滤波器目标跟踪方法[J].智能系统学报,2008,3(3):189.
　WANG Shao-yu,CAI Zi-xing,CHEN Ai-bin.Improved object tracking method for particle filters[J].CAAI Transactions on Intelligent Systems,2008,3():189.
[2]刘 清,吴志刚,窦 琴,等.粒子滤波的视频目标跟踪算法研究[J].智能系统学报,2009,4(6):538.[doi:10.3969/j.issn.1673-4785.2009.06.012]
　LIU Qing,WU Zhi-gang,DOU Qin,et al.A particle filtering algorithm for tracking moving objects in videos[J].CAAI Transactions on Intelligent Systems,2009,4():538.[doi:10.3969/j.issn.1673-4785.2009.06.012]
[3]伍 明,孙继银.一种机器人未知环境下动态目标跟踪交互多模滤波算法[J].智能系统学报,2010,5(2):127.
　WU Ming,SUN Ji-yin.An interacting multiple model filtering algorithm for mobile robots to improve tracking of moving objects in unknown environments[J].CAAI Transactions on Intelligent Systems,2010,5():127.
[4]李 金,胡文广.基于颜色的快速人体跟踪及遮挡处理[J].智能系统学报,2010,5(4):353.
　LI Jin,HU Wen-guang.Tracking fast movement using colors while accommodating occlusion[J].CAAI Transactions on Intelligent Systems,2010,5():353.
[5]刘侠,陶冶,邢春.统计差分与自启动的Camshift跟踪算法[J].智能系统学报,2011,6(4):355.
　LIU Xia,TAO Ye,XING Chun.An objective tracking Camshift algorithm based onautomatic startup and the statistical differential method[J].CAAI Transactions on Intelligent Systems,2011,6():355.
[6]伍明,孙继银.基于粒子滤波的未知环境下机器人同时定位、地图构建与目标跟踪[J].智能系统学报,2013,8(2):168.[doi:10.3969/j.issn.1673-4785.201202001]
　WU Ming,SUN Jiyin.Simultaneous localization, mapping and object tracking in an unknown environment using particle filtering[J].CAAI Transactions on Intelligent Systems,2013,8():168.[doi:10.3969/j.issn.1673-4785.201202001]
[7]贺超,刘华平,孙富春,等.采用Kinect的移动机器人目标跟踪与避障[J].智能系统学报,2013,8(5):426.[doi:10.3969/j.issn.1673-4785.201301028]
　HE Chao,LIU Huaping,SUN Fuchun,et al.Target tracking and obstacle avoidance of mobile robot using Kinect[J].CAAI Transactions on Intelligent Systems,2013,8():426.[doi:10.3969/j.issn.1673-4785.201301028]
[8]王熙,吴为,钱沄涛.基于轨迹聚类的超市顾客运动跟踪[J].智能系统学报,2015,10(2):187.[doi:10.3969/j.issn.1673-4785.201401002]
　WANG Xi,WU Wei,QIAN Yuntao.Trajectory clustering based customer movement tracking in a supermarket[J].CAAI Transactions on Intelligent Systems,2015,10():187.[doi:10.3969/j.issn.1673-4785.201401002]
[9]陈真,王钊.元认知粒子滤波目标跟踪算法[J].智能系统学报,2015,10(3):387.[doi:10.3969/j.issn.1673-4785.201405052]
　CHEN Zhen,WANG Zhao.Object tracking algorithm with metacognitive model-based particle filters[J].CAAI Transactions on Intelligent Systems,2015,10():387.[doi:10.3969/j.issn.1673-4785.201405052]
[10]王杰,蒋明敏,花晓慧,等.基于投影直方图匹配的双目视觉跟踪算法[J].智能系统学报,2015,10(5):775.[doi:10.11992/tis.201410009]
　WANG Jie,JIANG Mingmin,HUA Xiaohui,et al.Binocular object tracking method using projection histogram matching[J].CAAI Transactions on Intelligent Systems,2015,10():775.[doi:10.11992/tis.201410009]

备注/Memo

收稿日期:2021-07-12。
基金项目:国家自然科学基金项目（61503389）；陕西省自然科学基金项目（2015JM6313,2020JM358）
作者简介:伍明，副教授，博士，主要研究方向为自主机器人控制、多机器人协作、机器人环境构建。主持国家自然科学基金项目1项，陕西省自然科学基金项目2项,发表学术论文20余篇，出版专著1部;李广宇，讲师，主要研究方向为人工智能、资源优化管理。主持完成陕西省“十三五”规划课题1项，主持完成校级课题3项，发表学术论文17篇;魏振华，副教授，主要研究方向为信息通信和指挥信息系统。主持专项课题8项，发表学术论文10余篇。
通讯作者:魏振华. E-mail: weizhenhua8303@163.com

更新日期/Last Update: 1900-01-01
Copyright © 《 智能系统学报》 编辑部
地址：（150001）黑龙江省哈尔滨市南岗区南通大街145-1号楼 电话：0451- 82534001、82518134　邮箱：tis@vip.sina.com