YU Hua-long,ZHU Chang-ming,LIU Hai-bo,et al.A survey on developmental robotics[J].CAAI Transactions on Intelligent Systems,2007,2(04):34-39.





A survey on developmental robotics
于化龙朱长明刘海波顾国昌沈 晶
YU Hua-long ZHU Chang-ming LIU Hai-bo GU Guo-chang SHEN Jing
College of Computer Science and Technology, Harbin Engineering University, Harb in 150001, China
发育机器人 外成机器人 发育模型 发育学习
developmental robotics epigenetic robotics developmental model deve lopmental learning
发育机器人是国际上近年兴起的一个研究热点,但在国内相关研究工作尚未全面起步 .较为全面地介绍了发育机器人的基本概念、核心思想和发展历程,重点剖析了几种典型的发育模型和学习方法.针对该领域目前存在的学术争论, 如组成结构,研究目的和性能评价等,做了详细的探讨.本文最后从理论研究和应用两方面展望了发育机器人的发展趋势,并指出了需要进一步研究解决的问题.   
Developmental robotics is one of the most popular research interests f or many foreign researchers in recent years. However, the related studies haven ’t been done systematically in China. The paper presented the basic conception, main idea and history of the developmental robotics. Especially several represe ntative developmental models and learning methods were described in detail. Some controversial topics in this field, such as constitution, research purpose, per formance estimation and so on, are discussed detailedly. At last, it prospects t he developmental trend of the developmental robotics in the future from two aspe cts: theoretical research and application, and indicates the issues needed to be researched deeply.


[1] WENG J. Learning in image analysis and beyond: development [A]. Visual Communication and Image Processing[C]. New York,1998.
[2]WENG J, MCCLELLAND J, PENTLAND A, et al. Autonomous mental developmen t by robots and animals [J] . Science, 2001, 291: 599-600.
【3]ZLATEV J, BALKENIUS C. Introduction: why “epigenetic robotics”? [A]. Proce edings of the First International Workshop on Epigenetic Robotics [C].Lunden, 2 001.
[4]DANGAUTHIER P. Developmental robotics[A]. Proceedings of the AA AI Sprin g Symposium Workshop on Developmental Robotics[C]. Stanford, California, 2005.
[5]高 颖, 陈东岳, 张立明. 一种带有实时视觉特征学习的自主发育机器人探索[J].复旦大学学报(自然科学版),2005, 44(6): 964-970.
 GAO Ying, CHEN Dong yue, ZHANG Li ming. An exploration of autonomous developi ng robo t w i th real time vision learning[J]. Journal of Fudan University (Natural Science) , 2005, 44(6): 964-970.
[6]OUDEYER P Y, KAPLAN F, Hafner V. The playground experiment: task independent development of a curious robot[A]. Proceedings of the AAAI Spring Symposium Workshop on Developmental Robotics[C]. Stanford, California, 2005.
[7]KOZIMA H, NAKAGAWA C, YASUDA Y. Wowing together: what facilitates so cial int eractions in children with autistic spectrum disorders[A]. Proceedings of the sixth International Workshop on Epigenetic Robotics [C]. Paris, 2006. 
[8]DUQUETTE A, MERCIER H, MICHAUD F. Investigating the use of a mobile robot ic toy as an imitation Agent for children with autism[A]. Proceedings of the six th International Workshop on Epigenetic Robotics [C]. Paris, 2006. 
[9]WENG J. Developmental robotics: theory and experiments[J]. I nternatio nal Journal of Humanoid Robotics, 2004, 1(2):199-236.
[10]BLANK D, KUMAR D, MEEDEN L, et al. Bringing up robot: fundamental mech ani sms for creating a selfmotivated, selforganizing architecture[J]. Cybernetics and Systems, 2005,36(2): 125-150.
[11]STOJANOV G. Petitagé: a case study in developmental robotics[A]. Pro ceedi ngs of the First International Workshop on Epigenetic Robotics [C].Lund, 200 1 .
[12]WENG J, ZHANG Y, HWANG W S. Candid covariancefree incremental princ ipal co mponent analysis [J]. IEEE Trans Pattern Analysis and Machine Intelligence, 2 003, 25(8): 1034-1040.
【13]TAN K C, CHEN Y J, TAN K K, et al. Taskoriented developmental lear ning fo r humanoid robots[J]. IEEE Trans on Industry Electronics, 2005, 52(3): 906-91 4.[
[14]DRIANCOURT R. Learning perceptual organization with a development al robo t[A ]. Proceedings of the 2004 Conference on Computer Vision and Pattern Recogniti on Workshop[C]. Washington. DC, 2004.
【15]KOZMA R, FREEMAN W J. Encoding and recall of noisy data as chao tic spati ot emporal memory patterns in the style of the brains[A]. Proceedings of Interna tional Joint Conference on Neural Networks[C]. Como, Italy, 2000.
] [16]PIAGET J. The principles of genetic epistemology[M]. New York: Basi c Books, 1972.
[17]PEZZULO G, CALVI G. Toward a perceptual symbol system[A]. Proceedi ngs of the Sixth International Workshop on Epigenetic Robotics [C]. Paris, 2006. 
[18]TANIGUCHI T, SAWARAGI T. Incremental aquisition of compositional s chemat a b ased on behavioral learning[A]. Proceedings of the Sixth International Worksh op on Epigenetic Robotics [C]. Paris, 2006. 
[19]PAQUIER W, HUU N D, CHATILA R. A unified model for developmental Ro boti cs[ A]. Proceedings of the 3rd International Workshop on Epigenetic Robotics[C] . Boston, 2003.
[20]OGATA T, HATTORI Y, KOZIMA H, et al. Generation of robot motions from env iro nmental sounds using intermodality mapping by RNNPB[A]. Proceedings of the S ixth International Workshop on Epigenetic Robotics [C]. Paris, 2006.
[21]GERSHENSON C. Behaviourbased knowledge systems: an epigenetic p ath from be haviour to knowledge[A]. Proceedings of the 2nd Workshop on Epigenetic Roboti cs[C]. Edinburgh, 2002.
【22]NAGAI Y, ASADA M, HOSODA K. A developmental approach accelerates lear nin g o f joint attention[A]. Proceedings of the 2nd International Conference on Deve lopment and Learning[C]. Cambridge, Massachusetts, 2002.
[23]DANGAUTHIER P, BESSIAE`URE P, SPALANZANI A. Autosuperv ised lea rning in the Bayesian programming framework[A]. Proc of the IEEE Int Conf on Robotics and Automation[C]. Barcelona (ES), 2005.
[24]MARSHALL J, BLANK D, MEEDEN L. An emergent framework for selfmot ivation in developmental robotics[A]. Proceedings of the Third International Conference on Development and Learning (ICDL 2004) [C]. La Jolla, California 2004.
[25]STOUT A, KONIDARIS G, BARTO A. Intrinsically motivated reinforcement learning: a promising framework for developmental robot learning [A].Proceedings of the AAAI Spring Symposium on Developmental Robotics[C]. S tanford, CA, 2005.
[26]MAHADEVAN S. Protovalue functions: developmental reinforcement learnin g[A ]. Proceedings of the International Conference on Machine Learning [C]. Bon n, Germany, 2005.
[27]UCHIBE E, DOYA, K. Reinforcement learning with multiple heteroge neou s mod ules: a framework for developmental robot learning[A]. Proceedings of the 4th International Conference on Development and Learning[C]. Kobe, Japan ,2005.
[28]BARTO A. Intrinsic motivation, cumulative learning, and computation al reinforcement learning[A]. Proceedings of the Sixth International Workshop on Epigenetic[C]. Paris, 2006.
[29]NAGAI Y. Understanding the development of joint attention from a view point of cognitive developmental robotics[D]. Osaka University, 2004.
[30]BLANCHARD A. AMERO L. Developing affectmodulated behav iors: stab ility, exploration, exploitation, or imitation? [A]. Proceedings of the Sixth International Workshop on Epigenetic[C]. Paris, 2006.
[31]ANDRY P, REVEL A. Modeling synchrony for perceptionaction sys tem s coupling[A]. Proceedings of the Sixth International Workshop on Epigenetic [C]. Paris, 2006.
[32]KRUUSMAA M. Obstacle avoidance as a consequence of suppressing irre ver sibl e actions[A]. Proceedings of the Sixth International Workshop on Epigenetic[C ]. Paris, 2006.
[33]PRINCE C G, HELDER N A, HOLLICH G J. Ongoing emergence: a cor e concept in epigenetic robotics[A]. Proceedings of the fifth International Workshop on Ep ige netic Robotics: Modeling Cognitive Development in Robotic Systems[C]. Nara, Ja pan .2005.
[34]KAPLAN F, OUDEYER P Y. Trends in epigenetic robotics: atlas[ A]. Proce edi ngs of the sixth International Workshop on Epigenetic Robotics [C]. Paris, 20 06.


于化龙,男,1982年生,博士研究生,主要研究方向为智能机器人,发表学术论文1篇. E-mial:yuhualong@hrbeu.edu.cn.
刘海波,男,1976年生,博士,副教授,IEEE计算机学会专业会员,中国计算机学会会员,黑龙江省计算机学会智能人机交互专委会委员,主要研究方向为智能机器人体系结构,发表学术论文50余篇,出版编著3部,译著2部. 
更新日期/Last Update: 2009-05-07