[1]ZENG Hualin,HUANG Yuxuan,CHAO Fei,et al.Survey of robotic calligraphy research[J].CAAI Transactions on Intelligent Systems,2016,11(1):15-26.[doi:10.11992/tis.201507067]
Copy

Survey of robotic calligraphy research

CAAI Transactions on Intelligent Systems[ISSN 1673-4785/CN 23-1538/TP] Volume: 11 Number of periods: 2016 1 Page number: 15-26 Column: 综述 Public date: 2016-02-25
Title:
Survey of robotic calligraphy research
Author(s):
ZENG Hualin1; 2;  HUANG Yuxuan1; 2;  CHAO Fei1; 2;  ZHOU Changle1; 2
1. Cognitive Science Department, Xiamen University, Xiamen 361005, China;
2. Fujian Province Key Lab of Machine Intelligence and Robotics, Xiamen University, Xiamen 361005, China
Keywords:
robot; calligraphy robot; manipulators; motion control; intelligent control; imitation learning
CLC:
TP242.6
DOI:
10.11992/tis.201507067
Abstract:
By analyzing the features and significance of calligraphy robots, we reveal that robotic writing ability requires robots to have autonomous manual control to perform flexible and precise movements as well as to respond to dynamic environments. In this study, we review and analyze three aspects of current studies on calligraphy robots. First, we introduce and analyze existing robotic hardware. Next, we review related control algorithms for the motions of robotic writing. Finally, we introduce Chinese character font acquirement methods. Additionally, we discuss the advantages and disadvantages of current robotic control methods and font acquirement approaches. We point out that intelligent control technologies and imitation learning methods are the future development directions for improving robotic writing quality. In our conclusion, we predict the development of large-scale application fields and the timing for the commercial realization of calligraphy robots.
References:
[1] 周远清, 张再青. 智能机器人系统[M]. 北京:清华大学出版社, 1989:17-22.
[2] 曾庆军, 黄惟一. 智能遥控作业器——下一代机器人发展的重要生长点[J]. 机器人技术与应用, 1998, (3):7-10.
[3] 方建军, 何广平. 智能机器人[M]. 北京:化学化工出版社, 2004:1-14.
[4] CHAO Fei, ZHANG Xin, LIN Haixiong, et al. Learning robotic hand-eye coordination through a developmental constraint driven approach[J]. International journal of automation and computing, 2013, 10(5):414-424.
[5] SICILIANO B, KHATIB O. 机器人手册[M]. 北京:机械工业出版社, 2013:196-211. SICILIANO B, KHATIB O. Springer Handbook of Robotics[M]. Beijing:China Machine Press, 2013:196-211.
[6] MAN Yongkui, BIAN Chunyuan, ZHAO Hongbin, et al. A kind of calligraphy robot[C]//Proceedings of the 3rd International Conference on Information Sciences and Interaction Sciences (ICIS). Chengdu, China, 2010:635-638.
[7] WAI K K, YAM Y, WAH LO K. Vision system and projective rectification for a robot drawing platform[C]//Proceedings of IEEE International Conference on Control and Automation. Budapest, 2005:691-696.
[8] LAM J H M, YAM Y. Stroke trajectory generation experiment for a robotic Chinese calligrapher using a geometric brush footprint model[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. St. Louis, MO, 2009:2315-2320.
[9] MATSUI A, KATSURA S.A method of motion reproduction for calligraphy education[C]//IEEE International Conference on Mechatronics, 2013, 307(9):452-457.
[10] 何薇, 钱增磊, 唐超, 等. 基于机器视觉的机器人写字技术的设计[J]. 江南大学学报:自然科学版, 2011, 10(5):513-517. HE Wei, QIAN Zenglei, TANG Chao, et al. Design of writing by robot manipulator based on machine vision[J]. Journal of Jiangnan university:Natural Science Edition, 2011, 10(5):513-517.
[11] 宫晓博, 王建平. IRB140型工业机器人连续轨迹控制的汉字绘制[J]. 现代制造工程, 2010(2):135-137. GONG Xiaobo, WANG Jianping. Drawing Chinese character based on continuous path control of IRB140 industrial robot[J]. Modern manufacturing engineering, 2010(2):135-137.
[12] 张传剑, 李春梅, 韩军. MOTOMAN-UP6机器人写字功能设计与实现[J]. 机械制造与自动化, 2011, 40(2):119-121, 161. ZHANG Chuanjian, LI Chunmei, HAN Jun. Functional design and realization of writing for MOTOMAN-UP6 robots[J]. Machine building & automation, 2011, 40(2):119-121, 161.
[13] 薛环振. 运用机械臂的计算机书法创作系统设计与开发[D]. 上海:华东师范大学, 2011. XUE Huanzhen. Design and development of computer calligraphy creation system using robot arm[D]. Shanghai:East China Normal University, 2011.
[14] 俞凯. 计算机书法若干关键技术研究[D]. 杭州:浙江大学, 2010. YU Kai. Researches on some key technologies of computer calligraphy[D]. Hangzhou:Zhejiang University, 2010.
[15] 姜家宏. 平面关节型机器人结构优化研究[D]. 沈阳:东北大学, 2010. JIANG Jiahong. The structure optimization research of planar articulated robot[D]. Shenyang:Northeastern University, 2010.
[16] 杨成文. 平面关节机器人研制及其轨迹规划[D]. 广州:华南理工大学, 2012. YANG Chengwen. Research and development of the SCARA industrial robot and trajectory planning[D]. Guangzhou:South China University of Technology, 2012.
[17] 张红. SCARA机器人小臂结构特性分析[D]. 天津:天津大学, 2008. ZHANG Hong. Structural characteristic analysis of the SCARA robot’s small arm[D]. Tianjin:Tianjin University, 2008.
[18] 景兴碧, 万仁明, 张以都, 等. 软笔书法机器人[J]. 机器人技术与应用, 2000(6):21-23. JING Xingbi, WAN Renming, ZHANG Yidu, et al. A robot system for Chinese penmanship[J]. Robot technique and application, 2000(6):21-23.
[19] 曲波. 一种具有环境自适应能力的毛笔机器人[J]. 微型电脑应用, 2004, 20(10):42-44. QU Bo. An adaptive robot of calligraphist[J]. Microcomputer applications, 2004, 20(10):42-44.
[20] 乔金晶, 李志斌, 节鹏举, 等. 写字灵巧手系统研究[J]. 中国科技纵横, 2010, (23):39-40. QIAO Jinjing, LI Zhibing, JIE Pengju, et al. The research of the write dexterous hand system[J]. China science & technology, 2010, (23):39-40.
[21] KIM B H. Modeling and analysis of robotic dual soft-fingered writing[J]. International journal of precision engineering and manufacturing, 2009, 10(2):17-23.
[22] CRAINIC M F, PREITL S, SANDRU L A, et al. Secure handwriting using a robot arm for educational purpose[C]//Proceedings of the 19th International Conference On Methods and Models in Automation and Robotics (MMAR). Miedzyzdroje, 2014:58-63.
[23] 金英连, 程峰, 郑成伟, 等. 智能写字机器人机构与递阶控制系统设计[J]. 中国计量学院学报, 2009, 20(3):249-253. JIN Yinglian, CHENG Feng, ZHENG Chengwei, et al. Smart lettering robot mechanism and hierarchical control design[J]. Journal of China university of metrology, 2009, 20(3):249-253.
[24] 满翠华, 范迅, 李成荣. 画像机器人手臂运动学研究[J]. 起重运输机械, 2007(3):68-70. MAN Cuihua, FAN Xun, LI Chengrong. Kinematics simulation of painting robot bionics arm[J]. Hoisting and conveying machinery, 2007(3):68-70
[25] PLAMONDON R, DJIOUA M. A multi-level representation paradigm for handwriting stroke generation[J]. Human movement science, 2006, 25(4-5):586-607.
[26] GARRIDO J, YU Wen, SORIA A. Human behavior learning for robot in joint space[J]. Neurocomputing, 2015, 155:22-31.
[27] 王党校, 张玉茹, 姚冲. 力反馈汉字书法模拟的任务规划和逼真度评价方法[J]. 系统仿真学报, 2006, 18(8):2307-2326. WANG Dangxiao, ZHANG Yuru, Yao Chong. Task planning and fidelity evaluation in force enabled Chinese calligraphy simulation system[J]. Journal of system simulation, 2006, 18(8):2307-2326.
[28] KIM S K, JO J,OH Y. Robotic handwriting:Multi-contact manipulation based on Reactional Internal Contact Hypothesis[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014). Chicago, IL, 2014:877-884.
[29] TSUMUGIWA T, YOKOGAWA R, KHARA R. Variable impedance control based on estimation of human arm stiffness for human-robot cooperative calligraphic task[C]//Proceedings of IEEE International Conference on Robotics and Automation. Washington, DC, USA, 2002:644-650.
[30] POTKONJAK V. Robotic handwriting:Why and how[C]//Proceedings of the Conference on Interdisciplinary Applications of Kinematics. Lima, Perú, 2008:19-35.
[31] POTKONJAK V, KOSTIC D, TZAFESTAS S, et al. Human-like behavior of robot arms:general considerations and the handwriting task-Part II:the robot arm in handwriting[J]. Robotics and computer integrated manufacturing, 2001, 17(4):317-327.
[32] DJIOUA M, PLAMONDON R. Studying the variability of handwriting patterns using the Kinematic Theory[J]. human movement science, 2009, 28(5):588-601.
[33] HASHIGUCHI H, ARIMOTO S, OZAWA R. Control of a handwriting robot with DOF-redundancy based on feedback in task-coordinates[J]. Journal of robotics and mechatronics, 2004, 16(4):381-387.
[34] YAM Y. Realization of robotic Chinese calligraphy by an intelligent art robot[C]//Proceedings of the 4th Beijing-Hong Kong International Doctoral Forum. Shenzhen, China, 2009:1-4.
[35] LU Y, LAM J H M, YAM Y. Preliminary study on vision-based pen-and-ink drawing by a robotic manipulator[C]//Proceedings of IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Singapore, 2009:578-583.
[36] LAM J H M, YAM Y. Structural analysis based stroke segmentation for Chinese characters[C]//Proceedings of the 48th IEEE Conference on Decision and Control. Shanghai, China, 2009:3118-3123.
[37] DRONIOU A, IVALDI S, SIGAUD O. Learning a repertoire of actions with deep neural networks[C]//Proceedings of IEEE International Conferences on Development and Learning and Epigenetic Robotics (ICDL-Epirob). Genoa, 2014:229-234.
[38] WANG Zhengshuai, CHAO Fei, LIN Haixiong, et al. A Human-like learning approach to developmental robotic reaching[C]//Proceedings of IEEE International Conference on Robotics and Biomimetics (ROBIO). Shenzhen, China, 2013:581-586.
[39] WANG Zhengshuai, XU Guanghua, CHAO Fei. Integration of Brain-like neural network and infancy behaviors for robotic pointing[C]//Proceedings of the International Conference on Information science, Electronics and Electrical Engineering (ISEEE). Sapporo, 2014:1613-1618.
[40] CHAO Fei, WANG Zhengshuai, SHANG Changjing, et al. A developmental approach to robotic pointing via human-robot interaction[J]. Information sciences, 2014, 283:288-303.
[41] 王光建, 廖志勇, 陈雪华. 机器人写字技术及其运动参数[J]. 重庆大学学报:自然科学版, 2003, 26(12):6-9. WANG Guangjian, LIAO Zhiyong, CHEN Xuehua. Robot manipulator lettering technology and motion[J]. Journal of Chongqing university:natural science edition, 2003, 26(12):6-9.
[42] 王光建, 梁锡昌. 写字机器人的文字矢量化及应用[J]. 现代制造工程, 2004(7):40-42. WANG Guangjian, LIANG Xichang. Character vector and application in writing robot[J]. Modern manufacturing engineering, 2004(7):40-42.
[43] 汪涛. Windows95中字符轮廓线的提取和显示[J]. 微计算机应用, 1999, 20(2):86-88. WANG Tao. The extraction and display of character contour in Windows95[J]. Microcomputer applications, 1999, 20(2):86-88.
[44] YAO Fenghui, SHAO Guifeng. Modeling of ancient-style chinese character and its application to CCC robot[C]//Proceedings of the 2006 IEEE International Conference on Networking, Sensing and Control. Ft. Lauderdale, FL, 2006:72-77.
[45] YAO Fenghui, SHAO Guifeng, YI Jianqiang. Extracting the trajectory of writing brush in Chinese character calligraphy[J]. Engineering applications of artificial intelligence, 2004, 17(6):631-644.
[46] YAO Fenghui, SHAO Guifeng, YI Jianqiang. Trajectory generation of the writing-brush for a robot arm to inherit block-style Chinese character calligraphy techniques[J]. Advanced robotics, 2004, 18(3):331-356.
[47] LAM J H M, YAM Y. Application of brush footprint geometric model for realization of robotic Chinese calligraphy[C]//Proceedings of the 2nd International Conference on Cognitive Infocommunications (CogInfoCom). Budapest, 2011:1-5.
[48] CALDERON C A A, MOHAN R E, ZHOU Changjiu. Teaching new tricks to a robot learning to solve a task by imitation[C]//Proceedings of IEEE Conference on Robotics, Automation and Mechatronics. Singapore, 2010:256-262.
[49] LEMME A, REINHART R F, STEIL J J. Self-supervised bootstrapping of a movement primitive library from complex trajectories[C]//Proceedings of the 14th IEEE-RAS International Conference on Humanoid Robots (Humanoids). Madrid, 2014:726-732.
[50] MOHAN V, MORASSO P, ZENZERI J, et al. Teaching a humanoid robot to draw ‘Shapes’[J]. Autonomous robots, 2011, 31(1):21-53.
[51] FILIATRAULT S, CRETU A M. Human arm motion imitation by a humanoid robot[C]//Proceedings of IEEE International Symposium on Robotic and Sensors Environments (ROSE). Timisoara, 2014:31-36.
[52] CHAO Fei, CHEN Fuhai, SHEN Yuhang, et al. Robotic free writing of Chinese characters via Human-Robot interactions[J]. International journal of humanoid robotics, 2014, 11(1):1450007-1-26.
[53] CHAO Fei, SUN Yan, WANG Zhengshuai, et al. A reduced classifier ensemble approach to human gesture classification for robotic Chinese handwriting[C]//Proceedings of IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). Beijing, China, 2014:1720-1727.
[54] ACOSTA-CALDERON C A, HU H. Robot imitation:Body schema and body percept[J]. Applied bionics and biomechanics, 2005, 2(3-4):131-148.
[55] 吴建国, 俞庆英, 吴海辉. 汉字笔画若干数据的统计方法研究与应用[J]. 安徽大学学报:自然科学版, 2005, 29(3):14-20. WU Jianguo, YU Qingying, WU Haihui. Statistic on some Chinese character stroke information[J]. Journal of anhui university:natural science edition, 2005, 29(3):14-20.
[56] TAN Huan, DU Qian, WU Na. Robots learn writing[J]. Journal of robotics, 2012:505191.
[57] PéREZ-MARCOS D, ALBERTO BUITRAGO J, DANILO GIRALDO VELáSQUEZ F, et al. Writing through a robot:A proof of concept for a brain-machine interface[J]. Medical engineering & physics, 2011, 33(10):1314-1317.
Similar References:

Memo

-

Last Update: 1900-01-01

Copyright © CAAI Transactions on Intelligent Systems