[1]XU Rong,JIANG Feng,YAO Hong-xun.Overview of manifold learning[J].CAAI Transactions on Intelligent Systems,2006,1(1):44-51.
Copy

Overview of manifold learning

CAAI Transactions on Intelligent Systems[ISSN 1673-4785/CN 23-1538/TP] Volume: 1 Number of periods: 2006 1 Page number: 44-51 Column: 综述 Public date: 2006-03-25
Title:
Overview of manifold learning
Author(s):
XU Rong; JIANG Feng;  YAO Hong-xun
School of Computer Science and Technology, Harbin Institute of Technology，Ha rbin 150001，China
Keywords:
dimensionality reduction; manifold learning; Isomap; LLE; intersectin g manifold
CLC:
TP181
DOI:
-
Abstract:
As a new unsupervised learning method, manifold learning is capturing increasing interests of researchers in the field of machine learning and cogniti ve sciences. To understand manifold learning better, the topology concept of man ifold learning was presented firstly, and then its development history was trace d. Based on different representations of manifold, several major algo rithms were introduced, whose advantages and defects were pointed out resp ectively. After that , two kinds of typical applications of Isomap and LLE were indicated. The res ults show th at compared with traditional linear method, manifold learning can discover the in trinsic dimensions of nonlinear highdimensional data effectively, helping re searchers to reduce dimensionality and analyze data better. Finally the prospect of manifold learning was discussed, so as to extend the application area of man ifold learning.
References:
［1］ HYVRINEN A. Survey on independent component analysis［J］. Neural Computi ng Surveys , 1999，2(4): 94-128.
［2］ TURK M, PENTLAND A. Eigenfaces for recognition［J］. Journal of Cognitive Neuroscience , 1991,3(1):71-86.
［3］ GONZALEZ R C, WOODS R E. Digital image processing：2nd ed［M］. Beijing: Publishing House of Electronics Industry, 2003.
［4］ SEUNG H S, LEE D D. The manifold ways of perception［J］. Science, 2000,290(5500):2268-2269.
［5］ TENENBAUM J, SILVA D D, LANGFORD J. A global geometric framework for nonlinear dimensionality reduction［J］. Science, 2000, 290(5500): 2319-232 3.
［6］ ROWEIS S, SAUL L. Nonlinear dimensionality reduction by locally li near embedding［J］. Science, 2000, 290(5500): 2323-2326.
［7］ 王守觉. 仿生模式识别（拓扑模式识别）——一种模式识别新模型的理论与应用［J ］. 电子学报, 2002, 30(10):1417-1420.
WANG Shoujue. Bionic(Topological) pattern recognition—a new model of pattern r ecognition theory and its applications［J］. Acta Electronica Sinica, 2002,30(10 ): 1417-1420.
［8］ 张军平，曹存根. 神经网络及其应用［M］. 北京: 清华大学出版社, 2 004.
ZHANG Junping, CAO Cungen. Neural network and applications［M］. Beijing: Tsi nghua University Press, 2004.
［9］ ZHANG C S, WANG J, ZHAO N Y, ZHANG D. Reconstruction and analysis of multip ose face images based on nonlinear dimensionality reduction［J］. Pattern Recogn ition, 2004,37(1): 325-336.
［10］ 詹德川, 周志华. 基于集成的流形学习可视化［J］. 计算机研究与发展, 2005, 4 2 (9): 1533-1537.
ZHAN Dechuan, ZHOU Zhihua. Ensemblebased manifold learning for visuali zatio n［J］. Journal of Computer Research and Development, 2005, 42(9): 1533-1537.
［11］ 赵连伟, 罗四维, 赵艳敞,等. 高维数据的低维嵌入及嵌入维数研究［J］. 软件学报, 2005, 16(8): 1423-1430.
?ZHAO Lianwei, LUO Siwei, ZHAO Yanchang, et al. Study on the lowdime nsi onal embedding and the embedding dimensionality of manifold of highdimensional data［J］. Journal of Software, 2005, 16(8): 1423-1430.
［12］ 何??? 力, 张军平, 周志平. 基于放大因子和延伸方向研究流形学习算法［J］. 计算机学报, 2005, 28(12): 2000-2009.
?HE Li, ZHANG Junping, ZHOU Zhiping. Investigating manifold learning algori thms based on magnification factors and principal spread directions［J］. Chinese Jo urnal of Computers, 2005, 28(12): 2000-2009.
［13］ BELKIN M, NIYOGI P. Laplacian eigenmaps for dimensionality reducti on and data representation［J］. Neural Computation, 2003, 15(6): 1373-1396.
［14］ ZHANG Z Y, ZHA H Y. Principal manifolds and nonlinear dimensionali ty reduc tion via tangent space alignment［J］. SIAM Journal of Scientific Computing, 200 5, 26(1): 313-338.
［15］ SIMARD P Y, LECUN Y A, DENKER J S. Efficient pattern recognition using a n ew transformation distance［J］. Advances in Neural Information Processing Syste ms, 1993(5): 50-58.
［16］ ZHANG J P, LI S Z, WANG J. Intelligen t Mul timedia Processing with Soft Computing［C］. Heidelberg: Springer-Verlag, 2004. 
［17］ HASTIE T, STUETZLE W. Principla Curves［J］. Journal of the Ame rican Statistical Association, 1988, 84(406): 502-516.
［18］ K′EGL B, KRZYZAK A, LINDER T, ZEGER K. Learning and design of p rincipal cu rves［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(3): 281-297.
［19］ BISHOP C M, SEVENSEN M, WILLIAMS C K I. GTM: The generative top ographic mapping［J］. Neural Computation, 1998,10(1): 215-234.
［20］ CHANG K, GHOSH J. A unified model for probabilistic principal s urfaces［ J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(1) : 22-41.
［21］ SMOLA A J, MIKA S. Regularized principal manifolds［A］. In Computati onal Learning Theory: 4th European Conference［C］. New York: SpringerVerlag, 1999.
［22］ HINTON G， ROWEIS S. Stochastic neighbor embedding［A］. Neur al Informatio n Proceeding Systems: Natural and Synthetic［C］. Vancouver,Canada,2002.
［23］ BRAND M, MERL. Charting a manifold［A］. Neural Information Procee ding Systems: Natural and Synthetic［C］. Vancouver,Canada, 2002.
［24］ BORG I, GROENEN P. Modern multidimensional scaling: theory and app lication ［M］. NewYork: SpringerVerlag, 1997.
［25］ MIN W L, LU L, HE X F. Locality pursuit embedding［J］. Pattern Recognit ion, 2004, 37(4): 781-788.
［26］ 杨??? 剑, 李伏欣, 王??? 珏. 一种改进的局部切空间排列算法［J］. 软件学报, 200 5, 16(9): 1584-1589.
YANG Jian, LI Fuxin, WANG Jue. A better scaled local tangent space align ment algorithm［J］. Journal of Software, 2005,16(9): 1584-1589.
［27］ 翁时锋, 张长水, 张学工. 非线性降维在高维医学数据处理中的应用［J］. 清华大学学报(自然科学版), 2004,44(4): 485-488.
WENG Shifeng, ZHANG Changshui, ZHANG Xuegong. Nonlinear dimensionality red uct ion in the analysis of high dimensional medical data［J］. Journal of Tsinghua University(Sci & Tech), 2004, 44(4): 485-488.
Similar References:

Memo

-

Last Update: 2009-04-07

Copyright © CAAI Transactions on Intelligent Systems