[1]QIAO Jun-fei,ZHANG Ying.Fast unit pruning algorithm for multilayer feedforward network design[J].CAAI Transactions on Intelligent Systems,2008,3(2):173-176.
Copy

Fast unit pruning algorithm for multilayer feedforward network design

CAAI Transactions on Intelligent Systems[ISSN 1673-4785/CN 23-1538/TP] Volume: 3 Number of periods: 2008 2 Page number: 173-176 Column: 学术论文—智能系统 Public date: 2008-04-25
Title:
Fast unit pruning algorithm for multilayer feedforward network design
Author(s):
QIAO Jun-fei;  ZHANG Ying
College of Electronic and Control Engineering, Beijing University of Technology , Beijing 100022，China
Keywords:
optimal brain surgeon;  neural network pruning;  selforganization desig n
CLC:
TP183
DOI:
-
Abstract:
For it is difficult to determine the numbers of hidden neurons in the application of neural networks, a fast unit pruning algorithm for the structure of neural network was presented in the paper. The algorithm which based on optim al brain surgeon（OBS）eliminated the unneeded hidden neurons directly, in which way carried out the selforganization design on the structure of neural networ k s. The results of comparative studies with OBS showed that the fast unit pruning algorithm could reduce both neural network complexity and training time.
References:
［1］魏海坤,徐嗣鑫,宋文忠.神经网络的泛化理论和泛化方法［J］.自动化学报, 2001,27( 6):806815.
 WEI Haikun, XU Sixin,SONG Wenzhong. Generalization theory and generalization met hods for neural networks ［J］. Acta Automatica Sinica， 2001, 27(6): 806815.
［2］何述东.多层前向神经网络结构的研究进展［J］.控制理论与应用,1998, 15(3 ):313319.
 HE Shudong. Survey of architecture for multilayer feedfor ward neural networks ［J］. Control Theory and Applications, 1998,15(3):313319.
［3］MOODY J. Prediction risk and architecture selection for neural net works ［C］// Statistics to Neural Networks: Theory and Pattern Recognition Applications, NATO ASI Series F. New York， 1994.
［4］FAHLMAN S E , LEBIERE C. The cascadecorrelation learning architecture ［C］// Advances in Neural Information Processing Systems. San Mateo,USA,1990 .
［5］HASSIBI B. STORK D,WOLFF G. Optimal brain surgeon and general network prun ing［C］// IEEE International Conferenceon on Neural Networks. Perth,Australia,1993. 
［6］杨钟瑾,史忠科.快速自顶向下优化神经网络结构的方法［J］.系统仿真学报,2 005，17(1):162165.
YANG Zhongjin， SHI Zhongke. Fast approach for optimal brain surgeon［J］. Journ a l of System Simulation,2005,17(1):162165.
［7］李 倩,王永县,朱友芹. 人工神经网络混合剪枝算法［J］. 清华大学学报， 2005，45(6):831834.
LI Qian, WANG Yongxian,ZHU Youqin. Hybrid pruning algorithm for artificial neura l network training［J］. Journal of Tsinghua University, 2005，45（6）：831834.
［8］JAMES T L. Statistical method of pruning neural networks［C］// International Joint Conference on Neural Networks. Washington,DC,1999.
［9］KIERON M. Fast unit selection algorithm for neural network design［C ］// 15th International Conference on Pattern Recognition. Southampton,2000.
 ［10］MESSER K, KITTLER J. Choosing an optimal neural network size to a id search through a large image database［C］// Proc British Machine Vision Confe rence BMVC98.［S.l.］,1998.
Similar References:

Memo

-

Last Update: 2009-05-11

Copyright © CAAI Transactions on Intelligent Systems