[1]蔡军,陈科宇,张毅.基于Kinect的改进移动机器人视觉SLAM[J].智能系统学报,2018,13(5):734-740.[doi:10.11992/tis.201705018]
CAI Jun,CHEN Keyu,ZHANG Yi.Improved V-SLAM for mobile robots based on Kinect[J].CAAI Transactions on Intelligent Systems,2018,13(5):734-740.[doi:10.11992/tis.201705018]
点击复制
CAI Jun,CHEN Keyu,ZHANG Yi.Improved V-SLAM for mobile robots based on Kinect[J].CAAI Transactions on Intelligent Systems,2018,13(5):734-740.[doi:10.11992/tis.201705018]
基于Kinect的改进移动机器人视觉SLAM
《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷:
13
期数:
2018年第5期
页码:
734-740
栏目:
学术论文—智能系统
出版日期:
2018-09-05
- Title:
- Improved V-SLAM for mobile robots based on Kinect
- Keywords:
- mobile robot; Kinect; SLAM; ICP; key-frame; RANSAC; pose estimate; three-dimensional reconstruction
- 分类号:
- TP242.6
- 摘要:
- 针对传统ICP（iterative closest points，迭代最近点算法）存在易陷入局部最优、匹配误差大等问题，提出了一种新的欧氏距离和角度阈值双重限制方法，并在此基础上构建了基于Kinect的室内移动机器人RGB-D SLAM（simultaneous localization and mapping）系统。首先，使用Kinect获取室内环境的彩色信息和深度信息，通过图像特征提取与匹配，结合相机内参与像素点深度值，建立三维点云对应关系；然后，利用RANSAC（random sample consensus）算法剔除外点，完成点云的初匹配；采用改进的点云配准算法完成点云的精匹配；最后，在关键帧选取中引入权重，结合g2o（general graph optimization）算法对机器人位姿进行优化。实验证明该方法的有效性与可行性，提高了三维点云地图的精度，并估计出了机器人运行轨迹。
- Abstract:
- Given that the traditional iterative closest points (ICP) algorithm easily falls into the local optimum and has a large matching error, a novel double restriction method containing Euclidean distance and angle threshold is proposed. To realize this, an indoor mobile robot RGB-D SLAM (simultaneous localization and mapping) using a Kinect camera was developed. First, the Kinect camera was used to get color information and depth information for the indoor environment. Through the image feature extraction and matching procedure, the relationship between two 3D point clouds was established by combining the camera intrinsic parameters and pixel depth values. Then, the initial registration was completed using the random sample consensus (RANSAC) algorithm to remove outliers. Meanwhile, accurate registration was completed using the improved ICP algorithm. Finally, the weight was introduced into the selection of the key frames, and the general graph optimization (g2o) algorithm was used to optimize the pose of the robot. The experimental results prove effectiveness and feasibility of the method, and this method improves the accuracy of the 3D point cloud map and estimates the trajectory of the robot.
- 参考文献/References:
-
[1] ENDRES F, HESS J, STURM J, et al. 3-D mapping with an RGB-D camera[J]. IEEE transactions on robotics, 2014, 30(1):177-187.
[2] KERL C, STURM J, CREMERS D. Dense visual SLAM for RGB-D cameras[C]//Proceedings of 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. Tokyo, Japan, 2014:2100-2106.
[3] HOU Yi, ZHANG Hong, ZHOU Shilin. Convolutional neural network-based image representation for visual loop closure detection[C]//Proceedings of 2015 IEEE International Conference on Information and Automation. Lijiang, China, 2015:2238-2245.
[4] 解则晓, 徐尚. 三维点云数据拼接中ICP及其改进算法综述[J]. 中国海洋大学学报:自然科学版, 2010, 40(1):99-103 XIE Zexiao, XU Shang. A survey on the ICP algorithm and its variants in registration of 3D point clouds[J]. Periodical of ocean university of China, 2010, 40(1):99-103
[5] LIN C C, TAI Y C, LEE J J, et al. A novel point cloud registration using 2D image features[J]. Eurasip journal on advances in signal processing, 2017, 2017:5.
[6] 杨扬, 曹其新, 朱笑笑, 等. 面向机器人手眼协调抓取的3维建模方法[J]. 机器人, 2013, 35(2):151-155 YANG Yang, CAO Qixin, ZHU Xiaoxiao, et al. A 3D modeling method for robot’s hand-eye coordinated grasping[J]. Robot, 2013, 35(2):151-155
[7] ROSTEN E, PORTER R, DRUMMOND T. Faster and better:a machine learning approach to corner detection[J]. IEEE transactions on pattern analysis and machine intelligence, 2010, 32(1):105-119.
[8] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International journal of computer vision, 2004, 60(2):91-110.
[9] BAY H, ESS A, TUYTELAARS T, et al. speeded-up robust features (SURF)[J]. Computer vision and image understanding, 2008, 110(3):346-359.
[10] MUJA M, LOWE D G. Scalable nearest neighbor algorithms for high dimensional data[J]. IEEE transactions on pattern analysis and machine intelligence, 2014, 36(11):2227-2240.
[11] 陈胜勇, 刘盛. 基于OpenCV的计算机视觉技术实现[M]. 北京:科学出版社, 2008.
[12] DANIEL H C, KANNALA J, HEIKKILÄ J. Joint depth and color camera calibration with distortion correction[J]. IEEE transactions on pattern analysis and machine intelligence, 2012, 34(10):2058-2064.
[13] 朱德海, 郭浩, 苏伟. 点云库PCL学习教程[M]. 北京:北京航空航天大学出版社, 2012.
[14] KUMMERLE R, GRISETTI G, STRASDAT H, et al. G2o:a general framework for graph optimization[C]//Proceedings of 2011 IEEE International Conference on Robotics and Automation. Shanghai, China, 2011:3607-3613.
- 相似文献/References:
-
[1]蔡自兴,王 勇,王 璐.基于角点聚类的移动机器人自然路标检测与识别[J].智能系统学报,2006,1(1):52.
CAI Zi-xing,WANG Yong,WANG Lu.Corner clustering based detection and recognition of natural landmark for mobile robot[J].CAAI Transactions on Intelligent Systems,2006,1():52.
[2]杨甜甜,刘志远,陈 虹,等.移动机器人编队控制的现状与问题[J].智能系统学报,2007,2(4):21.
YANG Tian-tian,LIU Zhi-yuan,CHEN Hong,et al.Formation control of mobile robots: state and open prob lems[J].CAAI Transactions on Intelligent Systems,2007,2():21.
[3]李润伟,蔡自兴,童宇,等.基于ATM的提高狭窄环境探测精度的改进方法[J].智能系统学报,2008,3(4):283.
LI Run-wei,CAI Zi-xing,TONG Yu.Improving the accuracy of exploring the narrow environment by using ATM[J].CAAI Transactions on Intelligent Systems,2008,3():283.
[4]霍成立,谢 凡,秦世引.面向室内移动机器人的无迹滤波实时导航方法[J].智能系统学报,2009,4(4):295.
HUO Cheng-li,XIE Fan,QIN Shi-yin.A case study in realtime UKFbased navigation for indoor autonomous travel of mobile robots[J].CAAI Transactions on Intelligent Systems,2009,4():295.
[5]海 丹,李 勇,张 辉,等.无线传感器网络环境下基于粒子滤波的移动机器人SLAM算法[J].智能系统学报,2010,5(5):425.[doi:10.3969/j.issn.1673-4785.2010.05.008]
HAI Dan,LI Yong,ZHANG Hui,et al.Simultaneous localization and mapping of a mobile robot in wireless sensor networks based on particle filtering[J].CAAI Transactions on Intelligent Systems,2010,5():425.[doi:10.3969/j.issn.1673-4785.2010.05.008]
[6]房立金,王洪光.架空线移动机器人行走越障特点[J].智能系统学报,2010,5(6):492.
FANG Li-jin,WANG Hong-guang.Research on the characteristics of the movement and obstacleclearing processes of a wiresuspended mobile robot[J].CAAI Transactions on Intelligent Systems,2010,5():492.
[7]韩峥,刘华平,黄文炳,等.基于Kinect的机械臂目标抓取[J].智能系统学报,2013,8(2):149.[doi:10.3969/j.issn.1673-4785.201212038]
HAN Zheng,LIU Huaping,HUANG Wenbing,et al.Kinect-based object grasping by manipulator[J].CAAI Transactions on Intelligent Systems,2013,8():149.[doi:10.3969/j.issn.1673-4785.201212038]
[8]任立敏,王伟东,杜志江.移动机器人队形控制关键技术及其进展[J].智能系统学报,2013,8(5):381.[doi:10.3969/j.issn.1673-4785.201302011]
REN Limin,WANG Weidong,DU Zhijiang.Key technologies and development of? formation control of mobile robots[J].CAAI Transactions on Intelligent Systems,2013,8():381.[doi:10.3969/j.issn.1673-4785.201302011]
[9]雷丽充,刘华平,孙富春,等.面向灵巧操作的视觉目标识别[J].智能系统学报,2015,10(1):37.[doi:10.3969/j.issn.1673-4785.201311050]
LEI Lichong,LIU Huaping,SUN Fuchun,et al.Visual object recognition for smart manipulation[J].CAAI Transactions on Intelligent Systems,2015,10():37.[doi:10.3969/j.issn.1673-4785.201311050]
[10]阮晓钢,庞涛,张晓平,等.一种基于情感智能的机器人自主趋光行为研究[J].智能系统学报,2015,10(1):97.[doi:10.3969/j.issn.1673-4785.201312035]
RUAN Xiaogang,PANG Tao,ZHANG Xiaoping,et al.Research on the autonomous phototaxis behavior of a robot based on emotion intelligence[J].CAAI Transactions on Intelligent Systems,2015,10():97.[doi:10.3969/j.issn.1673-4785.201312035]
[11]贺超,刘华平,孙富春,等.采用Kinect的移动机器人目标跟踪与避障[J].智能系统学报,2013,8(5):426.[doi:10.3969/j.issn.1673-4785.201301028]
HE Chao,LIU Huaping,SUN Fuchun,et al.Target tracking and obstacle avoidance of mobile robot using Kinect[J].CAAI Transactions on Intelligent Systems,2013,8():426.[doi:10.3969/j.issn.1673-4785.201301028]
[12]张雪华,刘华平,孙富春,等.采用Kinect的移动机器人目标跟踪[J].智能系统学报,2014,9(1):34.[doi:10.3969/j.issn.1673-4785.201305080]
ZHANG Xuehua,LIU Huaping,SUN Fuchun,et al.Target tracking of mobile robot using Kinect[J].CAAI Transactions on Intelligent Systems,2014,9():34.[doi:10.3969/j.issn.1673-4785.201305080]
备注/Memo
收稿日期:2017-05-15。
基金项目:国家自然科学基金项目（61673079）；重庆市科学技术委员会资助项目（cstc2015jcyjBX0066）.
作者简介:蔡军,男,1977年生,副教授,主要研究方向为机器人技术、信号处理、模式识别。发表学术论文9篇,主编和参编教材5部;陈科宇,男,1992年生,硕士研究生,主要研究方向为机器人同时定位与地图构建、机器人三维视觉导航;张毅,男,1966年生,教授,博士生导师,中国人工智能学会理事,主要研究方向为智能系统与移动机器人、机器视觉与模式识别、多传感器信息融合。主持完成国家级和省部级基金项目10余项,获国家发明专利10余项。发表学术论文160余篇,被SCI、EI检索80余篇。
通讯作者:陈科宇.E-mail:keyu1118@163.com.
更新日期/Last Update:
2018-10-25