[1]RUAN Xiaogang,PANG Tao,ZHANG Xiaoping,et al.Research on the autonomous phototaxis behavior of a robot based on emotion intelligence[J].CAAI Transactions on Intelligent Systems,2015,10(1):97-102.[doi:10.3969/j.issn.1673-4785.201312035]
Copy

Research on the autonomous phototaxis behavior of a robot based on emotion intelligence

CAAI Transactions on Intelligent Systems[ISSN 1673-4785/CN 23-1538/TP] Volume: 10 Number of periods: 2015 1 Page number: 97-102 Column: 学术论文—智能系统 Public date: 2015-03-25
Title:
Research on the autonomous phototaxis behavior of a robot based on emotion intelligence
Author(s):
RUAN Xiaogang1;  PANG Tao1; 2;  ZHANG Xiaoping1;  WANG Ershen2
1. College of Electronic and Control Engineering, Beijing University of Technology, Beijing 100124, China;
2. College of Electronic Information Engineering, Shenyang Aerospace University, Shenyang 110136, China
Keywords:
cognitive robotics; intrinsic motivation; mobile robot; phototaxis skill; emotion intelligence; sensorimotor system; fuzzy reasoning method; orientation
CLC:
TP242.6
DOI:
10.3969/j.issn.1673-4785.201312035
Abstract:
In this paper, a kind of bionic learning mechanism of intrinsic motivation on the basis of emotion intelligence is proposed for the autonomous phototaxis behavior of a mobile robot. The learning mechanism is on the basis of the learning mechanism of the sensorimotor system of a living body, including the links of evaluation, behavioral choices and orientation. The emotion model is constructed by the fuzzy neural network and the output of emotion model is taken as the internal reward signal of the evaluation link. The learning mechanism may make a robot gradually form, develop and perfect the phototaxis skills by autonomous learning and training in an unknown environment. The emotion intelligence may increase the number of exploratory successes and reduce the learning steps. The simulation results demonstrated the effectiveness of this method.
References:
[1] OUDEYER P, KAPLAN F. What is intrinsic motivation? a typology of computational approaches[J]. Frontiers in Neurorobotics, 2007, 1(6): 1-14.
[2] SINGH S. Intrinsically motivated reinforcement learning: an evolutionary perspective[J]. IEEE Transactions on Autonomous Mental Development, 2010, 2(2): 70-82.
[3] AHN H, PICARD R W. Affective cognitive learning and decision making: the role of emotions[C]//The 18th European Meeting on Cybernetics and Systems Research. [s.l.], 2006: 1-6.
[4] MALFAZ M, SALICHS M A. Learning to avoid risky actions[J]. Cybernetics and Systems, 2011, 42(8): 636-658.
[5] SEQUEIRA P, MELO F S, PAIVA A. Emotion-based intrinsic motivation for reinforcement learning agents[C]//Affective Computing and Intelligent Interaction. Berlin: Springer, 2011: 326-336.
[6] ABDI J, MOSHIRI B, ABDULHAI B, et al. Short-term traffic flow forecasting: parametric and nonparametric approaches via emotional temporal difference learning[J]. Neural Computing and Applications, 2013,23:141-159.
[7] 刘明, 许力. 人工情感在Agent行为选择策略中的应用[J]. 江南大学学报, 2003, 2(6):564-568.LIU Ming, XU Li. Study on artificial emotion and its application in the behavior selection strategy of agents[J]. Journal of Southern Yangtze University, 2003,2(6): 564-568.
[8] 张惠娣,刘士荣. 基于情感与环境认知的移动机器人自主导航控制[J]. 控制理论与应用, 2008, 25(6): 995-1000.ZHANG Huidi, LIU Shirong. Autonomous navigation control for mobile robots based on emotion and environment cognition[J]. Control Theory & Applications, 2008, 25(6): 995-1000.
[9] 胡云斗,胡丹丹,高庆吉. 一种基于任务的机器人情感决策模型的构建[J]. 机器人, 2010, 32(4):464-477.HU Yundou, HU Dandan, GAO Qingji. Construction of a robot emotion decision-making model based on tasks[J]. Robot, 2010, 32(4):464-477.
[10] 祝宇虹,毛俊鑫. 基于人工情感与Q学习的机器人行为决策[J]. 智能工程, 2008, 61(7): 61-65.ZHU Yuhong, MAO Junxin. Robot’s behavioral decision-making strategy based on artificial emotion and Q-learning[J]. Intelligent Engineering, 2008, 61(7): 61-65.
[11] ASADA M, UCHIBE E, HOSODA K. Cooperative behavior acquisition for mobile robots in dynamically changing real worlds via vision-based reinforcement learning and development[J]. Artificial Intelligence, 1999, 110(2): 275-292.
[12] HUMBERT J S, HYSLOP A M. Bioinspired visuomotor convergence[J]. IEEE Transactions on Robotics, 2010, 26: 121-30.
[13] ZOLLO L, ESKIZMIRLILER S, TETI G, et al. An anthropomorphic robotic platform for progressive and adaptive sensorimotor learning[J]. Advanced Robotics, 2008, 22: 91-118.
[14] BARANES A, OUDEYER P Y. Active learning of inverse models with intrinsically motivated goal exploration in robots[J]. Robotics and Autonomous Systems, 2013, 61(1): 49-73.
[15] VIGORITO C M, BARTO A G. Intrinsically motivated hierarchical skill learning in structured environments[J]. IEEE Transactions on Autonomous Mental Development, 2010, 2(2): 132-143.
[16] EI-NASR M S, YEN J. Agents, emotion intelligence and fuzzy logic[C]//Proceedings of the North American Conference on the Fuzzy Information Processing Society. Pensacola Beach, 1998,1:135-140.
[17] DEGAONKAR V N, APTE S D. Emotion modeling from speech signal based on wavelet packet transform[J]. International Journal of Speech Technology, 2013, 16(1): 1-5.
[18] ORTONY A. The cognitive structure of emotions[M]. Cambridge:Cambridge University Press, 1990:35-77.
[19] OUDEYER P Y, KAPLAN F, HAFNER V V. Intrinsic motivation systems for autonomous mental development[J]. IEEE Transactions on Evolutionary Computation, 2007, 11(2): 265-286.
[20] ZORAN M, MARKO M, MIHAILO L, et al. Neural network reinforcement learning for visual control of robot manipulators[J]. Expert Systems with Applications, 2013, 40(5): 1721-1736.
Similar References:

Memo

-

Last Update: 2015-06-16

Copyright © CAAI Transactions on Intelligent Systems