[1]饶官军,古天龙,常亮,等.基于相似性负采样的知识图谱嵌入[J].智能系统学报,2020,15(2):218-226.[doi:10.11992/tis.201811022]
RAO Guanjun,GU Tianlong,CHANG Liang,et al.Knowledge graph embedding based on similarity negative sampling[J].CAAI Transactions on Intelligent Systems,2020,15(2):218-226.[doi:10.11992/tis.201811022]
点击复制
RAO Guanjun,GU Tianlong,CHANG Liang,et al.Knowledge graph embedding based on similarity negative sampling[J].CAAI Transactions on Intelligent Systems,2020,15(2):218-226.[doi:10.11992/tis.201811022]
基于相似性负采样的知识图谱嵌入
《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷:
15
期数:
2020年第2期
页码:
218-226
栏目:
学术论文—知识工程
出版日期:
2020-03-05
- Title:
- Knowledge graph embedding based on similarity negative sampling
- Keywords:
- knowledge graph; representation learning; random sampling; similarity sampling; K-means clustering; stochastic gradient descent; link prediction; triple classification
- 分类号:
- TP391
- 摘要:
- 针对现有知识图谱嵌入模型通过从实体集中随机抽取一个实体来生成负例三元组，导致负例三元组质量较低，影响了实体与关系的特征学习能力。研究了影响负例三元组质量的相关因素，提出了基于实体相似性负采样的方法来生成高质量的负例三元组。在相似性负采样方法中，首先使用K-Means聚类算法将所有实体划分为多个组，然后从正例三元组中头实体所在的簇中选择一个实体替换头实体，并以类似的方法替换尾实体。通过将相似性负采样方法与TransE相结合得到TransE-SNS。研究结果表明：TransE-SNS在链路预测和三元组分类任务上取得了显著的进步。
- Abstract:
- For the existing knowledge graph embedding model, the random extraction of an entity from the entity set results in the generation of lower-quality negative triples, and this affects the feature learning ability of the entity and the relationship. In this paper, we study the related factors affecting the quality of negative triples, and propose an entity similarity negative sampling method to generate high-quality negative triples. In the similarity negative sampling method, all entities are first divided into a number of groups using the K-means clustering algorithm. Then, corresponding to each positive triple, an entity is selected to replace the head entity from the cluster, whereby the head entity is located in the positive triple, and the tail entity is replaced in a similar approach. TransE-SNS is obtained by combining the similarity negative sampling method with TransE. Experimental results show that TransE-SNS has made significant progress in link prediction and triplet classification tasks.
- 参考文献/References:
-
[1] BOLLACKER K, EVANS C, PARITOSH P, et al. Freebase: a collaboratively created graph database for structuring human knowledge[C]//Proceedings of 2008 ACM SIGMOD International Conference on Management of Data. Vancouver, Canada, 2008: 1247-1250.
[2] MILLER G A. WordNet: a lexical database for English[J]. Communications of the ACM, 1995, 38(11): 39-41.
[3] CARLSON A, BETTERIDGE J, KISIEL B, et al. Toward an architecture for never-ending language learning[C]//Proceedings of the 24th AAAI Conference on Artificial Intelligence. Atlanta, USA, 2010: 1306-1313.
[4] BORDES A, WESTON J, USUNIER N. Open question answering with weakly supervised embedding models[C]//Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Nancy, France, 2014: 165-180.
[5] DONG Xin, GABRILOVICH E, HEITZ G, et al. Knowledge vault: a web-scale approach to probabilistic knowledge fusion[C]//Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA, 2014: 601-610.
[6] BORDES A, USUNIER N, GARCIA-DURáN A, et al. Translating embeddings for modeling multi-relational data[C]//International Conference on Neural Information Processing Systems. South Lake Tahoe, USA, 2013: 2787-2795.
[7] 刘知远, 孙茂松, 林衍凯, 等. 知识表示学习研究进展[J]. 计算机研究与发展, 2016, 53(2): 247-261
LIU Zhiyuan, SUN Maosong, LIN Yankai, et al. Knowledge representation learning: a review[J]. Journal of computer research and development, 2016, 53(2): 247-261
[8] WANG Zhen, ZHANG Jianwen, FENG Jianlin, et al. Knowledge graph embedding by translating on hyperplanes[C]//Proceedings of the 28th AAAI Conference on Artificial Intelligence. Québec City, Canada, 2014: 1112-1119.
[9] LIN Yankai, LIU Zhiyuan, SUN Maosong, et al. Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the 29th AAAI Conference on Artificial Intelligence. Austin, USA, 2015: 2181-2187.
[10] JI Guoliang, HE Shizhu, XU Liheng, et al. Knowledge graph embedding via dynamic mapping matrix[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. Beijing, China, 2015: 687-696.
[11] JI Guoliang, LIU Kang, HE Shizhu, et al. Knowledge graph completion with adaptive sparse transfer matrix[C]//Proceedings of the 30th AAAI Conference on Artificial Intelligence. Phoenix, USA, 2016: 985-991.
[12] FENG Jun, HUANG Minlie, WANG Mingdong, et al. Knowledge graph embedding by flexible translation[C]//Proceedings of the 15th International Conference on Principles of Knowledge Representation and Reasoning. Cape Town, South Africa, 2016: 557-560.
[13] CHANG Liang, ZHU Manli, GU Tianlong, et al. Knowledge graph embedding by dynamic translation[J]. IEEE access, 2017, 5: 20898-20907.
[14] TAN Zhen, ZHAO Xiang, FANG Yang, et al. GTrans: generic knowledge graph embedding via multi-state entities and dynamic relation spaces[J]. IEEE access, 2018: 8232-8244.
[15] WANG Peifeng, LI Shuangyin, PAN Rong. Incorporating GAN for negative sampling in knowledge representation learning[C]//Proceedings of the 32nd AAAI Conference on Artificial Intelligence. New Orleans, USA, 2018: 2005-2012.
[16] HARTIGAN J A, WONG M A. Algorithm AS 136: a K-Means clustering algorithm[J]. Journal of the royal statistical society, 1979, 28(1): 100-108.
[17] HAMERLY G, ELKAN C. Alternatives to the K-Means algorithm that find better clusterings[C]//Proceedings of the 11th International Conference on Information and Knowledge Management. McLean, USA, 2002: 600-607.
[18] CELEBI M E, KINGRAVI H A, VELA P A. A comparative study of efficient initialization methods for the k-means clustering algorithm[J]. Expert systems with applications, 2013, 40(1): 200-210.
[19] DUCHI J, HAZAN E, SINGER Y. Dearly adaptive subgradient methods for online learning and stochastic optimization[J]. Journal of machine learning research, 2011, 12(7): 257-269.
[20] BORDES A, GLOROT X, WESTON J, et al. A semantic matching energy function for learning with multi-relational data: application to word-sense disambiguation[J]. Machine learning, 2014, 94(2): 233-259.
[21] SOCHER R, CHEN Danqi, MANNING C D, et al. Reasoning with neural tensor networks for knowledge base completion[C]//Proceedings of the 26th International Conference on Neural Information Processing Systems. Lake Tahoe, USA, 2013: 926-934.
- 相似文献/References:
-
[1]崔婉秋,杜军平,周南,等.基于用户意图理解的社交网络跨媒体搜索与挖掘[J].智能系统学报,2017,12(6):761.[doi:10.11992/tis.201706075]
CUI Wanqiu,DU Junping,ZHOU Nan,et al.Social network cross-media searching and mining based on user intention[J].CAAI Transactions on Intelligent Systems,2017,12():761.[doi:10.11992/tis.201706075]
[2]常亮,张伟涛,古天龙,等.知识图谱的推荐系统综述[J].智能系统学报,2019,14(2):207.[doi:10.11992/tis.201805001]
CHANG Liang,ZHANG Weitao,GU Tianlong,et al.Review of recommendation systems based on knowledge graph[J].CAAI Transactions on Intelligent Systems,2019,14():207.[doi:10.11992/tis.201805001]
[3]贾中浩,古天龙,宾辰忠,等.旅游知识图谱特征学习的景点推荐[J].智能系统学报,2019,14(3):430.[doi:10.11992/tis.201810032]
JIA Zhonghao,GU Tianlong,BIN Chenzhong,et al.Tourism knowledge-graph feature learning for attraction recommendations[J].CAAI Transactions on Intelligent Systems,2019,14():430.[doi:10.11992/tis.201810032]
[4]王坤,谢振平,陈梅婕.基于图约简的知识联想关系网络建模[J].智能系统学报,2019,14(4):679.[doi:10.11992/tis.201808009]
WANG Kun,XIE Zhenping,CHEN Meijie.Modeling knowledge network on associative relations based on graph reduction[J].CAAI Transactions on Intelligent Systems,2019,14():679.[doi:10.11992/tis.201808009]
[5]秦娅,申国伟,余红星.基于Hadoop的大规模网络安全实体识别方法[J].智能系统学报,2019,14(5):1017.[doi:10.11992/tis.201809024]
QIN Ya,SHEN Guowei,YU Hongxing.Large-scale network security entity recognition method based on Hadoop[J].CAAI Transactions on Intelligent Systems,2019,14():1017.[doi:10.11992/tis.201809024]
[6]张潇鲲,刘琰,陈静.引入外部词向量的文本信息网络表示学习[J].智能系统学报,2019,14(5):1056.[doi:10.11992/tis.201809037]
ZHANG Xiaokun,LIU Yan,CHEN Jing.Representation learning using network embedding based on external word vectors[J].CAAI Transactions on Intelligent Systems,2019,14():1056.[doi:10.11992/tis.201809037]
[7]贾中浩,宾辰忠,古天龙,等.基于知识图谱和用户长短期偏好的个性化景点推荐[J].智能系统学报,2020,15(5):990.[doi:10.11992/tis.201904064]
JIA Zhonghao,BIN Chenzhong,GU Tianlong,et al.Personalized attraction recommendation based on the knowledge graph and users’ long-term and short-term preferences[J].CAAI Transactions on Intelligent Systems,2020,15():990.[doi:10.11992/tis.201904064]
[8]陈新元,谢晟祎,陈庆强,等.结合卷积特征提取和路径语义的知识推理[J].智能系统学报,2021,16(4):729.[doi:10.11992/tis.202008007]
CHEN Xinyuan,XIE Shengyi,CHEN Qingqiang,et al.Knowledge-based inference on convolutional feature extraction and path semantics[J].CAAI Transactions on Intelligent Systems,2021,16():729.[doi:10.11992/tis.202008007]
[9]罗玲,李硕凯,何清,等.基于知识图谱、TF-IDF和BERT模型的冬奥知识问答系统[J].智能系统学报,2021,16(4):819.[doi:10.11992/tis.202105047]
LUO Ling,LI Shuokai,HE Qing,et al.Winter Olympic Q & A system based on knowledge map, TF-IDF and BERT model[J].CAAI Transactions on Intelligent Systems,2021,16():819.[doi:10.11992/tis.202105047]
[10]黄庆明,王树徽,许倩倩,等.以图像视频为中心的跨媒体分析与推理[J].智能系统学报,2021,16(5):835.[doi:10.11992/tis.202105042]
HUANG Qingming,WANG Shuhui,XU Qianqian,et al.Image video centered cross-media analysis and reasoning[J].CAAI Transactions on Intelligent Systems,2021,16():835.[doi:10.11992/tis.202105042]
[11]李军怀,武允文,王怀军,等.融合实体描述与路径信息的知识图谱表示学习模型[J].智能系统学报,2023,18(1):153.[doi:10.11992/tis.202112010]
LI Junhuai,WU Yunwen,WANG Huaijun,et al.Knowledge graph representation learning model combining entity description and path information[J].CAAI Transactions on Intelligent Systems,2023,18():153.[doi:10.11992/tis.202112010]
备注/Memo
收稿日期:2018-12-04。
基金项目:国家自然科学基金资助项目(U1501252，61572146)；广西创新驱动重大专项项目(AA17202024)；广西自然科学基金项目(2016GXNSFDA380006)；广西高校中青年教师基础能力提升项目(2018KYD203)；广西研究生教育创新计划项目(YCSW2018139)
作者简介:饶官军，硕士研究生，主要研究方向为知识图谱、表示学习;古天龙，教授，博士生导师，主要研究方向为形式化方法、知识工程与符号推理、协议工程与移动计算、可信泛在网络、嵌入式系统。主持国家863计划项目、国家自然科学基金项目、国防预研重点项目、国防预研基金项目等30余项，出版学术著作3部，发表学术论文130余篇;常亮，教授，博士，中国计算机学会高级会员，主要研究方向为数据与知识工程、形式化方法、智能系统。主持并完成国家自然科学基金项目1项、广西省自然科学基金项目1项。发表学术论文70余篇
通讯作者:宾辰忠.E-mail:cz_bin@guet.edu.cn
更新日期/Last Update:
1900-01-01