[1]曾华琳,黄雨轩,晁飞,等.书写机器人研究综述[J].智能系统学报编辑部,2016,11(1):15-26.[doi:10.11992/tis.201507067]
ZENG Hualin,HUANG Yuxuan,CHAO Fei,et al.Survey of robotic calligraphy research[J].CAAI Transactions on Intelligent Systems,2016,11(1):15-26.[doi:10.11992/tis.201507067]
点击复制
ZENG Hualin,HUANG Yuxuan,CHAO Fei,et al.Survey of robotic calligraphy research[J].CAAI Transactions on Intelligent Systems,2016,11(1):15-26.[doi:10.11992/tis.201507067]
书写机器人研究综述
《智能系统学报》编辑部[ISSN 1673-4785/CN 23-1538/TP] 卷:
11
期数:
2016年第1期
页码:
15-26
栏目:
综述
出版日期:
2016-02-25
- Title:
- Survey of robotic calligraphy research
- Keywords:
- robot; calligraphy robot; manipulators; motion control; intelligent control; imitation learning
- 分类号:
- TP242.6
- 摘要:
- 通过分析书写机器人所具有的特征与实现意义,明确了机器人书写能力需要机器人能够自主控制机械手,实现灵活和准确的动作,并且观察动态环境变化。论文从3个方面回顾和分析了当前书写机器人的研究。首先介绍并分析了书写机器人硬件结构的知识,其次回顾了现有的控制机器人书写动作的相关算法,之后介绍了机器人书写过程中汉字信息的获取方式。此外,讨论了书写机器人在控制方法和字体获取方法方面的优劣,并指出了书写机器人可以利用智能控制技术与模仿学习方法来提高书写质量。最后展望了书写机器人的规模化应用领域。
- Abstract:
- By analyzing the features and significance of calligraphy robots, we reveal that robotic writing ability requires robots to have autonomous manual control to perform flexible and precise movements as well as to respond to dynamic environments. In this study, we review and analyze three aspects of current studies on calligraphy robots. First, we introduce and analyze existing robotic hardware. Next, we review related control algorithms for the motions of robotic writing. Finally, we introduce Chinese character font acquirement methods. Additionally, we discuss the advantages and disadvantages of current robotic control methods and font acquirement approaches. We point out that intelligent control technologies and imitation learning methods are the future development directions for improving robotic writing quality. In our conclusion, we predict the development of large-scale application fields and the timing for the commercial realization of calligraphy robots.
- 参考文献/References:
-
[1] 周远清, 张再青. 智能机器人系统[M]. 北京:清华大学出版社, 1989:17-22.
[2] 曾庆军, 黄惟一. 智能遥控作业器——下一代机器人发展的重要生长点[J]. 机器人技术与应用, 1998, (3):7-10.
[3] 方建军, 何广平. 智能机器人[M]. 北京:化学化工出版社, 2004:1-14.
[4] CHAO Fei, ZHANG Xin, LIN Haixiong, et al. Learning robotic hand-eye coordination through a developmental constraint driven approach[J]. International journal of automation and computing, 2013, 10(5):414-424.
[5] SICILIANO B, KHATIB O. 机器人手册[M]. 北京:机械工业出版社, 2013:196-211. SICILIANO B, KHATIB O. Springer Handbook of Robotics[M]. Beijing:China Machine Press, 2013:196-211.
[6] MAN Yongkui, BIAN Chunyuan, ZHAO Hongbin, et al. A kind of calligraphy robot[C]//Proceedings of the 3rd International Conference on Information Sciences and Interaction Sciences (ICIS). Chengdu, China, 2010:635-638.
[7] WAI K K, YAM Y, WAH LO K. Vision system and projective rectification for a robot drawing platform[C]//Proceedings of IEEE International Conference on Control and Automation. Budapest, 2005:691-696.
[8] LAM J H M, YAM Y. Stroke trajectory generation experiment for a robotic Chinese calligrapher using a geometric brush footprint model[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. St. Louis, MO, 2009:2315-2320.
[9] MATSUI A, KATSURA S.A method of motion reproduction for calligraphy education[C]//IEEE International Conference on Mechatronics, 2013, 307(9):452-457.
[10] 何薇, 钱增磊, 唐超, 等. 基于机器视觉的机器人写字技术的设计[J]. 江南大学学报:自然科学版, 2011, 10(5):513-517. HE Wei, QIAN Zenglei, TANG Chao, et al. Design of writing by robot manipulator based on machine vision[J]. Journal of Jiangnan university:Natural Science Edition, 2011, 10(5):513-517.
[11] 宫晓博, 王建平. IRB140型工业机器人连续轨迹控制的汉字绘制[J]. 现代制造工程, 2010(2):135-137. GONG Xiaobo, WANG Jianping. Drawing Chinese character based on continuous path control of IRB140 industrial robot[J]. Modern manufacturing engineering, 2010(2):135-137.
[12] 张传剑, 李春梅, 韩军. MOTOMAN-UP6机器人写字功能设计与实现[J]. 机械制造与自动化, 2011, 40(2):119-121, 161. ZHANG Chuanjian, LI Chunmei, HAN Jun. Functional design and realization of writing for MOTOMAN-UP6 robots[J]. Machine building & automation, 2011, 40(2):119-121, 161.
[13] 薛环振. 运用机械臂的计算机书法创作系统设计与开发[D]. 上海:华东师范大学, 2011. XUE Huanzhen. Design and development of computer calligraphy creation system using robot arm[D]. Shanghai:East China Normal University, 2011.
[14] 俞凯. 计算机书法若干关键技术研究[D]. 杭州:浙江大学, 2010. YU Kai. Researches on some key technologies of computer calligraphy[D]. Hangzhou:Zhejiang University, 2010.
[15] 姜家宏. 平面关节型机器人结构优化研究[D]. 沈阳:东北大学, 2010. JIANG Jiahong. The structure optimization research of planar articulated robot[D]. Shenyang:Northeastern University, 2010.
[16] 杨成文. 平面关节机器人研制及其轨迹规划[D]. 广州:华南理工大学, 2012. YANG Chengwen. Research and development of the SCARA industrial robot and trajectory planning[D]. Guangzhou:South China University of Technology, 2012.
[17] 张红. SCARA机器人小臂结构特性分析[D]. 天津:天津大学, 2008. ZHANG Hong. Structural characteristic analysis of the SCARA robot’s small arm[D]. Tianjin:Tianjin University, 2008.
[18] 景兴碧, 万仁明, 张以都, 等. 软笔书法机器人[J]. 机器人技术与应用, 2000(6):21-23. JING Xingbi, WAN Renming, ZHANG Yidu, et al. A robot system for Chinese penmanship[J]. Robot technique and application, 2000(6):21-23.
[19] 曲波. 一种具有环境自适应能力的毛笔机器人[J]. 微型电脑应用, 2004, 20(10):42-44. QU Bo. An adaptive robot of calligraphist[J]. Microcomputer applications, 2004, 20(10):42-44.
[20] 乔金晶, 李志斌, 节鹏举, 等. 写字灵巧手系统研究[J]. 中国科技纵横, 2010, (23):39-40. QIAO Jinjing, LI Zhibing, JIE Pengju, et al. The research of the write dexterous hand system[J]. China science & technology, 2010, (23):39-40.
[21] KIM B H. Modeling and analysis of robotic dual soft-fingered writing[J]. International journal of precision engineering and manufacturing, 2009, 10(2):17-23.
[22] CRAINIC M F, PREITL S, SANDRU L A, et al. Secure handwriting using a robot arm for educational purpose[C]//Proceedings of the 19th International Conference On Methods and Models in Automation and Robotics (MMAR). Miedzyzdroje, 2014:58-63.
[23] 金英连, 程峰, 郑成伟, 等. 智能写字机器人机构与递阶控制系统设计[J]. 中国计量学院学报, 2009, 20(3):249-253. JIN Yinglian, CHENG Feng, ZHENG Chengwei, et al. Smart lettering robot mechanism and hierarchical control design[J]. Journal of China university of metrology, 2009, 20(3):249-253.
[24] 满翠华, 范迅, 李成荣. 画像机器人手臂运动学研究[J]. 起重运输机械, 2007(3):68-70. MAN Cuihua, FAN Xun, LI Chengrong. Kinematics simulation of painting robot bionics arm[J]. Hoisting and conveying machinery, 2007(3):68-70
[25] PLAMONDON R, DJIOUA M. A multi-level representation paradigm for handwriting stroke generation[J]. Human movement science, 2006, 25(4-5):586-607.
[26] GARRIDO J, YU Wen, SORIA A. Human behavior learning for robot in joint space[J]. Neurocomputing, 2015, 155:22-31.
[27] 王党校, 张玉茹, 姚冲. 力反馈汉字书法模拟的任务规划和逼真度评价方法[J]. 系统仿真学报, 2006, 18(8):2307-2326. WANG Dangxiao, ZHANG Yuru, Yao Chong. Task planning and fidelity evaluation in force enabled Chinese calligraphy simulation system[J]. Journal of system simulation, 2006, 18(8):2307-2326.
[28] KIM S K, JO J,OH Y. Robotic handwriting:Multi-contact manipulation based on Reactional Internal Contact Hypothesis[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014). Chicago, IL, 2014:877-884.
[29] TSUMUGIWA T, YOKOGAWA R, KHARA R. Variable impedance control based on estimation of human arm stiffness for human-robot cooperative calligraphic task[C]//Proceedings of IEEE International Conference on Robotics and Automation. Washington, DC, USA, 2002:644-650.
[30] POTKONJAK V. Robotic handwriting:Why and how[C]//Proceedings of the Conference on Interdisciplinary Applications of Kinematics. Lima, Perú, 2008:19-35.
[31] POTKONJAK V, KOSTIC D, TZAFESTAS S, et al. Human-like behavior of robot arms:general considerations and the handwriting task-Part II:the robot arm in handwriting[J]. Robotics and computer integrated manufacturing, 2001, 17(4):317-327.
[32] DJIOUA M, PLAMONDON R. Studying the variability of handwriting patterns using the Kinematic Theory[J]. human movement science, 2009, 28(5):588-601.
[33] HASHIGUCHI H, ARIMOTO S, OZAWA R. Control of a handwriting robot with DOF-redundancy based on feedback in task-coordinates[J]. Journal of robotics and mechatronics, 2004, 16(4):381-387.
[34] YAM Y. Realization of robotic Chinese calligraphy by an intelligent art robot[C]//Proceedings of the 4th Beijing-Hong Kong International Doctoral Forum. Shenzhen, China, 2009:1-4.
[35] LU Y, LAM J H M, YAM Y. Preliminary study on vision-based pen-and-ink drawing by a robotic manipulator[C]//Proceedings of IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Singapore, 2009:578-583.
[36] LAM J H M, YAM Y. Structural analysis based stroke segmentation for Chinese characters[C]//Proceedings of the 48th IEEE Conference on Decision and Control. Shanghai, China, 2009:3118-3123.
[37] DRONIOU A, IVALDI S, SIGAUD O. Learning a repertoire of actions with deep neural networks[C]//Proceedings of IEEE International Conferences on Development and Learning and Epigenetic Robotics (ICDL-Epirob). Genoa, 2014:229-234.
[38] WANG Zhengshuai, CHAO Fei, LIN Haixiong, et al. A Human-like learning approach to developmental robotic reaching[C]//Proceedings of IEEE International Conference on Robotics and Biomimetics (ROBIO). Shenzhen, China, 2013:581-586.
[39] WANG Zhengshuai, XU Guanghua, CHAO Fei. Integration of Brain-like neural network and infancy behaviors for robotic pointing[C]//Proceedings of the International Conference on Information science, Electronics and Electrical Engineering (ISEEE). Sapporo, 2014:1613-1618.
[40] CHAO Fei, WANG Zhengshuai, SHANG Changjing, et al. A developmental approach to robotic pointing via human-robot interaction[J]. Information sciences, 2014, 283:288-303.
[41] 王光建, 廖志勇, 陈雪华. 机器人写字技术及其运动参数[J]. 重庆大学学报:自然科学版, 2003, 26(12):6-9. WANG Guangjian, LIAO Zhiyong, CHEN Xuehua. Robot manipulator lettering technology and motion[J]. Journal of Chongqing university:natural science edition, 2003, 26(12):6-9.
[42] 王光建, 梁锡昌. 写字机器人的文字矢量化及应用[J]. 现代制造工程, 2004(7):40-42. WANG Guangjian, LIANG Xichang. Character vector and application in writing robot[J]. Modern manufacturing engineering, 2004(7):40-42.
[43] 汪涛. Windows95中字符轮廓线的提取和显示[J]. 微计算机应用, 1999, 20(2):86-88. WANG Tao. The extraction and display of character contour in Windows95[J]. Microcomputer applications, 1999, 20(2):86-88.
[44] YAO Fenghui, SHAO Guifeng. Modeling of ancient-style chinese character and its application to CCC robot[C]//Proceedings of the 2006 IEEE International Conference on Networking, Sensing and Control. Ft. Lauderdale, FL, 2006:72-77.
[45] YAO Fenghui, SHAO Guifeng, YI Jianqiang. Extracting the trajectory of writing brush in Chinese character calligraphy[J]. Engineering applications of artificial intelligence, 2004, 17(6):631-644.
[46] YAO Fenghui, SHAO Guifeng, YI Jianqiang. Trajectory generation of the writing-brush for a robot arm to inherit block-style Chinese character calligraphy techniques[J]. Advanced robotics, 2004, 18(3):331-356.
[47] LAM J H M, YAM Y. Application of brush footprint geometric model for realization of robotic Chinese calligraphy[C]//Proceedings of the 2nd International Conference on Cognitive Infocommunications (CogInfoCom). Budapest, 2011:1-5.
[48] CALDERON C A A, MOHAN R E, ZHOU Changjiu. Teaching new tricks to a robot learning to solve a task by imitation[C]//Proceedings of IEEE Conference on Robotics, Automation and Mechatronics. Singapore, 2010:256-262.
[49] LEMME A, REINHART R F, STEIL J J. Self-supervised bootstrapping of a movement primitive library from complex trajectories[C]//Proceedings of the 14th IEEE-RAS International Conference on Humanoid Robots (Humanoids). Madrid, 2014:726-732.
[50] MOHAN V, MORASSO P, ZENZERI J, et al. Teaching a humanoid robot to draw ‘Shapes’[J]. Autonomous robots, 2011, 31(1):21-53.
[51] FILIATRAULT S, CRETU A M. Human arm motion imitation by a humanoid robot[C]//Proceedings of IEEE International Symposium on Robotic and Sensors Environments (ROSE). Timisoara, 2014:31-36.
[52] CHAO Fei, CHEN Fuhai, SHEN Yuhang, et al. Robotic free writing of Chinese characters via Human-Robot interactions[J]. International journal of humanoid robotics, 2014, 11(1):1450007-1-26.
[53] CHAO Fei, SUN Yan, WANG Zhengshuai, et al. A reduced classifier ensemble approach to human gesture classification for robotic Chinese handwriting[C]//Proceedings of IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). Beijing, China, 2014:1720-1727.
[54] ACOSTA-CALDERON C A, HU H. Robot imitation:Body schema and body percept[J]. Applied bionics and biomechanics, 2005, 2(3-4):131-148.
[55] 吴建国, 俞庆英, 吴海辉. 汉字笔画若干数据的统计方法研究与应用[J]. 安徽大学学报:自然科学版, 2005, 29(3):14-20. WU Jianguo, YU Qingying, WU Haihui. Statistic on some Chinese character stroke information[J]. Journal of anhui university:natural science edition, 2005, 29(3):14-20.
[56] TAN Huan, DU Qian, WU Na. Robots learn writing[J]. Journal of robotics, 2012:505191.
[57] PéREZ-MARCOS D, ALBERTO BUITRAGO J, DANILO GIRALDO VELáSQUEZ F, et al. Writing through a robot:A proof of concept for a brain-machine interface[J]. Medical engineering & physics, 2011, 33(10):1314-1317.
- 相似文献/References:
-
[1]方勇纯.机器人视觉伺服研究综述[J].智能系统学报编辑部,2008,3(2):109.
FANG Yong-chun.A survey of robot visual servoing[J].CAAI Transactions on Intelligent Systems,2008,3():109.
[2]王立权,刘秉昊,吴健荣,等.6R关节型机器人运动学建模[J].智能系统学报编辑部,2010,5(2):156.
WANG Li-quan,LIU Bing-hao,WU Jian-rong,et al.Modeling and implementing the inverse kinematics ofa six revolute joint robot[J].CAAI Transactions on Intelligent Systems,2010,5():156.
[3]孙宁,方勇纯.一类欠驱动系统的控制方法综述[J].智能系统学报编辑部,2011,6(3):200.
SUN Ning,FANG Yongchun.A review for the control of a class of underactuated systems[J].CAAI Transactions on Intelligent Systems,2011,6():200.
[4]蒲兴成,张军,张毅.基于神经网络的改进行为协调控制及其在智能轮椅路径规划中的应用[J].智能系统学报编辑部,2011,6(5):456.
PU Xingcheng,ZHANG Jun,ZHANG Yi.Modified behavior coordination for intelligent wheelchair path planning based on a neural network[J].CAAI Transactions on Intelligent Systems,2011,6():456.
[5]李晓飞,刘宏.机器人听觉声源定位研究综述[J].智能系统学报编辑部,2012,7(1):9.
LI Xiaofei,LIU Hong.A survey of sound source localization for robot audition[J].CAAI Transactions on Intelligent Systems,2012,7():9.
[6]孙凤池,宋萌,刘光.一种无线传感器信号衰减自适应测距模型[J].智能系统学报编辑部,2012,7(3):214.
SUN Fengchi,SONG Meng,LIU Guang.An adaptive ranging model based on energy distance loss of wireless sensors[J].CAAI Transactions on Intelligent Systems,2012,7():214.
[7]孙玉香,曹会彬,冯勇,等.具有拨土功能的轮腿一体化机器人结构设计[J].智能系统学报编辑部,2012,7(5):409.
SUN Yuxiang,CAO Huibin,FENG Yong,et al.Structure design on a legwheeledintegration robotwith an earthmoving function[J].CAAI Transactions on Intelligent Systems,2012,7():409.
[8]伍明,李琳琳,李承剑.基于协方差交集的多机器人协作目标跟踪算法[J].智能系统学报编辑部,2013,8(1):66.[doi:10.3969/j.issn.1673-4785.201204022]
WU Ming,LI Linlin,LI Chengjian.An algorithm of multi robot cooperative object tracking based on covariance intersection[J].CAAI Transactions on Intelligent Systems,2013,8():66.[doi:10.3969/j.issn.1673-4785.201204022]
[9]肖国宝,严宣辉.一种基于改进Theta *的机器人路径规划算法[J].智能系统学报编辑部,2013,8(1):58.[doi:10.3969/j.issn.1673-4785.201208032]
XIAO Guobao,YAN Xuanhui.A path planning algorithm based on improved Theta * for mobile robot[J].CAAI Transactions on Intelligent Systems,2013,8():58.[doi:10.3969/j.issn.1673-4785.201208032]
[10]李大伟,贾鹏飞,李卫国,等.一种基于卡尔曼滤波与模糊算法的变电站机器人组合导航及控制系统设计[J].智能系统学报编辑部,2013,8(3):226.
LI Dawei,JIA Pengfei,LI Weiguo,et al.A kind of integrated navigation and control system design for substation robot based on the Kalman filtering and fuzzy algorithm[J].CAAI Transactions on Intelligent Systems,2013,8():226.
备注/Memo
收稿日期:2015-07-28;改回日期:。
基金项目:国家自然科学基金资助项目(61203336,61273338).
作者简介:曾华琳,女,1980年生,讲师,博士研究生,主要研究方向为自然语言处理、机器学习;晁飞,男,1981年生,讲师,博士,主要研究方向为智能机器人、发展型机器人学习算法、人工神经网络和集成分类器算法。主持国家自然科学基金项目1项,发表学术论文20余篇;周昌乐,男,1959年生,教授,博士生导师,主要研究方向为仿脑智能系统、自然语言处理、艺术认知计算。主持国家自然科学基金项目多项、"973"项目子课题1项,发表学术论文200余篇,并有多本专著。
通讯作者:晁飞.E-mail:fchao@xmu.edu.cn.
更新日期/Last Update:
1900-01-01