[1]林大华,杨利锋,邓振云,等.稀疏样本自表达子空间聚类算法[J].智能系统学报,2016,11(5):696-702.[doi:10.11992/tis.201601005]
LIN Dahua,YANG Lifeng,DENG Zhenyun,et al.Sparse sample self-representation for subspace clustering[J].CAAI Transactions on Intelligent Systems,2016,11(5):696-702.[doi:10.11992/tis.201601005]
点击复制
LIN Dahua,YANG Lifeng,DENG Zhenyun,et al.Sparse sample self-representation for subspace clustering[J].CAAI Transactions on Intelligent Systems,2016,11(5):696-702.[doi:10.11992/tis.201601005]
稀疏样本自表达子空间聚类算法
《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷:
11
期数:
2016年第5期
页码:
696-702
栏目:
学术论文—机器学习
出版日期:
2016-11-01
- Title:
- Sparse sample self-representation for subspace clustering
- Keywords:
- subspace clustering; spectral clustering; subspace structure; similarity matrix; sample self-representation
- 分类号:
- TP181
- 摘要:
- 针对现有子空间聚类算法在构造相似度矩阵时，没有同时利用样本自表达和稀疏相似度矩阵以及去除噪音、离群点的干扰相结合，提出了一种新的稀疏样本自表达子空间聚类方法。该方法通过样本自表达而充分利用样本间固有相关性的本质，创新性地同时使用L1-范数和L2，1-范数正则化项惩罚相似度矩阵，即对所有测试样本进行稀疏样本自表达，从而确保每个测试样本由与其相关性强的样本表示，并使所获得的相似度矩阵具有良好的子空间结构和鲁棒性。通过Hopkins155和人脸图像等大量数据集的实验结果表明，本文方法在实际数据的子空间聚类中能够获得非常好的效果。
- Abstract:
- Existing subspace clustering methods do not combine sample self-representation well with affinity matrix sparsity, for example, by removing disturbances from noise, outliers, etc., when constructing the affinity matrix. This paper proposes a novel subspace clustering method called sparse sample self-representation for subspace clustering. This method fully considers the correlation between the samples, and also takes advantage of L1-norm and L2,1-norm terms to "penalize" the affinity matrix; that is, it conducts sparse sample self-representation for all test samples, to guarantee every sample can be expressed by any other samples with strong similarity and make it more robust. The experimental results of the Hopkins155 dataset and some facial image datasets show that the proposed method outperforms the LSR, SSC, and LRR methods in terms of the subspace clustering error.
- 参考文献/References:
-
[1] 王卫卫, 李小平, 冯象初, 等. 稀疏子空间聚类综述[J]. 自动化学报, 2015, 41(8):1373-1384. WANG Weiwei, LI Xiaoping, FENG Xiangchu, et al. A survey on sparse subspace clustering[J]. Acta automatica sinica, 2015, 41(8):1373-1384.
[2] VIDAL R, MA Yi, SASTRY S. Generalized principal component analysis (GPCA)[J]. IEEE transactions on pattern analysis and machine intelligence, 2005, 27(12):1945-1959.
[3] TSENG P. Nearest q-flat to m points[J]. Journal of optimization theory and applications, 2000, 105(1):249-252.
[4] FISCHLER M A, BOLLES R C. Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6):381-395.
[5] ELHAMIFAR E, VIDAL R. Sparse subspace clustering:algorithm, theory, and applications[J]. IEEE transactions on pattern analysis and machine intelligence, 2013, 35(11):2765-2781.
[6] LIU Guangcan, LIN Zhouchen, YAN Shuicheng, et al. Robust recovery of subspace structures by low-rank representation[J]. IEEE transactions on pattern analysis and machine intelligence, 2013, 35(1):171-184.
[7] LU Canyi, MIN Hai, ZHAO Zhongqiu, et al. Robust and efficient subspace segmentation via least squares regression[C]//Proceedings of the 12th European Conference on Computer Vision. Berlin Heidelberg, 2012:347-360.
[8] FENG Jiashi, LIN Zhouchen, XU Huan, et al. Robust subspace segmentation with block-diagonal prior[C]//Proceedings of Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA, 2014:3818-3825.
[9] 欧阳佩佩, 赵志刚, 刘桂峰. 一种改进的稀疏子空间聚类算法[J]. 青岛大学学报:自然科学版, 2014, 27(3):44-48. OUYANG Peipei, ZHAO Zhigang, LIU Guifeng. An improved sparse subspace clustering algorithm[J]. Journal of Qingdao university:natural science edition, 2014, 27(3):44-48.
[10] 杨国亮, 罗璐, 丰义琴, 等. 基于低秩稀疏图的结构保持投影算法[J]. 计算机工程与科学, 2015, 37(8):1584-1590. YANG Guoliang, LUO Lu, FENG Yiqin, et al. Structure preserving projection algorithm based on low rank and sparse graph[J]. Computer engineering and science, 2015, 37(8):1584-1590.
[11] ZHU Xiaofeng, HUANG Zi, YANG Yang, et al. Self-taught dimensionality reduction on the high-dimensional small-sized data[J]. Pattern recognition, 2013, 46(1):215-229.
[12] ZHANG Shichao, QIN Zhenxing, LING C X, et al. "Missing is useful":missing values in cost-sensitive decision trees[J]. IEEE transactions on knowledge and data engineering, 2005, 17(12):1689-1693.
[13] ZHU Xiaofeng, HUANG Zi, CUI Jiangtao, et al. Video-to-shot tag propagation by graph sparse group lasso[J]. IEEE transactions on multimedia, 2013, 15(3):633-646.
[14] ZHU Xiaofeng, ZHANG Lei, HUANG Zi. A sparse embedding and least variance encoding approach to hashing[J]. IEEE transactions on image processing, 2014, 23(9):3737-3750.
[15] TRON R, VIDAL R. A benchmark for the comparison of 3-D motion segmentation algorithms[C]//Proceedings of Conference on Computer Vision and Pattern Recognition. Minneapolis, MN, USA, 2007:1-8.
[16] LYONS M, AKAMATSU S, KAMACHI M, et al. Coding facial expressions with gabor wavelets[C]//Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition. Nara, 1998:200-205.
[17] HULL J J. A database for handwritten text recognition research[J]. IEEE transactions on pattern analysis and machine intelligence, 1994, 16(5):550-554.
[18] SAMARIA F S, HARTERT A C. Parameterisation of a stochastic model for human face identification[C]//Proceedings of the 2nd IEEE Workshop on Applications of Computer Vision. Sarasota, FL, USA, 1994:138-142.
[19] FENG Jiashi, LIN Zhouchen, XU Huan, et al. Robust subspace segmentation with block-diagonal prior[C]//Proceedings of Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA, 2014:3818-3825.
- 相似文献/References:
-
[1]汪? 中,刘贵全,陈恩红.基于模糊K-harmonic means的谱聚类算法[J].智能系统学报,2009,4(2):95.
WANG Zhong,LIU Gui-quan,CHEN En-hong.A spectral clustering algorithm based on fuzzy Kharmonic means[J].CAAI Transactions on Intelligent Systems,2009,4():95.
[2]张伟伟,薄 华,王晓峰.多特征-谱聚类的SAR图像溢油分割[J].智能系统学报,2010,5(6):551.
ZHANG Wei-wei,BO Hua,WANG Xiao-feng.SAR oil spill image segmentationbased on a multispectral clustering algorithm[J].CAAI Transactions on Intelligent Systems,2010,5():551.
[3]赵晓晓,周治平.结合稀疏表示与约束传递的半监督谱聚类算法[J].智能系统学报,2018,13(5):855.[doi:10.11992/tis.201703013]
ZHAO Xiaoxiao,ZHOU Zhiping.A semi-supervised spectral clustering algorithm combined with sparse representation and constraint propagation[J].CAAI Transactions on Intelligent Systems,2018,13():855.[doi:10.11992/tis.201703013]
[4]储德润,周治平.公理化模糊共享近邻自适应谱聚类算法[J].智能系统学报,2019,14(5):897.[doi:10.11992/tis.201810002]
CHU Derun,ZHOU Zhiping.Shared nearest neighbor adaptive spectral clustering algorithm based on axiomatic fuzzy set theory[J].CAAI Transactions on Intelligent Systems,2019,14():897.[doi:10.11992/tis.201810002]
[5]王一宾,李田力,程玉胜.结合谱聚类的标记分布学习[J].智能系统学报,2019,14(5):966.[doi:10.11992/tis.201809019]
WANG Yibin,LI Tianli,CHENG Yusheng.Label distribution learning based on spectral clustering[J].CAAI Transactions on Intelligent Systems,2019,14():966.[doi:10.11992/tis.201809019]
[6]王中元,刘惊雷.低秩分块矩阵的核近似[J].智能系统学报,2019,14(6):1209.[doi:10.11992/tis.201904058]
WANG Zhongyuan,LIU Jinglei.Kernel approximation of a low-rank block matrix[J].CAAI Transactions on Intelligent Systems,2019,14():1209.[doi:10.11992/tis.201904058]
[7]储德润,周治平.加权PageRank改进地标表示的自编码谱聚类算法[J].智能系统学报,2020,15(2):302.[doi:10.11992/tis.201904021]
CHU Derun,ZHOU Zhiping.An autoencoder spectral clustering algorithm for improving landmark representation by weighted PageRank[J].CAAI Transactions on Intelligent Systems,2020,15():302.[doi:10.11992/tis.201904021]
[8]刘金平,周嘉铭,贺俊宾,等.面向不均衡数据的融合谱聚类的自适应过采样法[J].智能系统学报,2020,15(4):732.[doi:10.11992/tis.201909062]
LIU Jinping,ZHOU Jiaming,HE Junbin,et al.Spectral clustering-fused adaptive synthetic oversampling approach for imbalanced data processing[J].CAAI Transactions on Intelligent Systems,2020,15():732.[doi:10.11992/tis.201909062]
[9]王丽娟,丁世飞.一种基于ELM-AE特征表示的谱聚类算法[J].智能系统学报,2021,16(3):560.[doi:10.11992/tis.202005021]
WANG Lijuan,DING Shifei.A spectral clustering algorithm based on ELM-AE feature representation[J].CAAI Transactions on Intelligent Systems,2021,16():560.[doi:10.11992/tis.202005021]
[10]毕志臻,杨德刚,冯骥.面向超大规模数据的自适应谱聚类算法[J].智能系统学报,2023,18(2):251.[doi:10.11992/tis.202110038]
BI Zhizhen,YANG Degang,FENG Ji.Self-adaptive spectral clustering algorithm for ultra-large-scale data[J].CAAI Transactions on Intelligent Systems,2023,18():251.[doi:10.11992/tis.202110038]
备注/Memo
收稿日期:2016-01-04。
基金项目:国家自然科学基金项目（61263035，61573270，61450001）；国家973计划项目（2013CB329404）；中国博士后科学基金项目（2015M570837）；广西自然科学基金项目（2015GXNSFCB139011）；广西研究生教育创新计划项目（YCSZ2016046，YCSZ2016045）.
作者简介:林大华,男,1979年生,主要研究方向为机器学习、数据挖掘;杨利锋,男,1989年生,硕士研究生,主要研究方向为数据挖掘和机器学习;邓振云,男,1991年生,硕士研究生,主要研究方向为机器学习、数据挖掘。发表学术论文8篇,其中被SCI、EI检索4篇。
通讯作者:杨利锋.E-mail:517567113@qq.com
更新日期/Last Update:
1900-01-01