[1]夏睿,宗成庆.情感文本分类混合模型及特征扩展策略[J].智能系统学报,2011,6(6):483-488.
XIA Rui,ZONG Chengqing.A hybrid approach to sentiment classification and feature expansion strategy[J].CAAI Transactions on Intelligent Systems,2011,6(6):483-488.
点击复制
XIA Rui,ZONG Chengqing.A hybrid approach to sentiment classification and feature expansion strategy[J].CAAI Transactions on Intelligent Systems,2011,6(6):483-488.
情感文本分类混合模型及特征扩展策略
《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷:
6
期数:
2011年第6期
页码:
483-488
栏目:
学术论文—自然语言处理与理解
出版日期:
2011-12-25
- Title:
- A hybrid approach to sentiment classification and feature expansion strategy
- 文章编号:
- 1673-4785(2011)06-0483-06
- 分类号:
- TP391.1
- 文献标志码:
- A
- 摘要:
- 针对篇章级别情感文本分类问题，分析了传统的生成式模型和判别式模型的性能，提出了一种级联式情感文本分类混合模型以及句法结构特征扩展策略.在该模型中，生成式模型（朴素贝叶斯分类器）和判别式模型（支持向量机）以级联的方式进行组合，旨在消除对于分类临界样本，模型判决置信度不足引起的误差.在混合模型的基础上，提出了一种高效扩展依存句法特征的策略.该策略既提高了系统的正确率，又避免了传统特征扩展方法所带来的计算量增加的问题.实验结果表明，混合模型及特征扩展策略与传统方法相比，在算法准确性和效率上，都有显著的提高.
- Abstract:
- In this paper, focusing on sentiment text classification, the performance of generative and discriminative models for sentiment classification was studied, and a hybrid approach to sentiment classification was proposed. The individual generative classifier (naive Bayes，(NB) and the discriminative classifier (support vector machines，SVM) were merged into a hybrid version in a twostage process in order to overcome individual drawbacks and benefit from the merits of both systems. On the basis of the hybrid classifier, an efficient strategy of incorporating dependency features was also presented. The strategy not only increases the accuracy of the system, but also avoids the defects of increased computing volume brought by the traditional feature expansion method. Experimental results show the apparent advantages of this approach in both classification accuracy and efficiency.
- 参考文献/References:
-
［1］宗成庆. 统计自然语言处理［M］. 北京: 清华大学出版社, 2008： 2328.
［2］PANG B， LEE L. Opinion mining and sentiment analysis［J］. Foundations and Trends in Information Retrieval, 2008, 2: 1135.
［3］PANG B. Thumbs up? sentiment classification using machine learning techniques［C］//Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). Philadelphia, USA, 2002: 7986.
［4］XIA R. Ensemble of feature sets and classification algorithms for sentiment classification［J］. Information Sciences, 2011, 181: 11381152.
［5］RILOFF E, PATWARDHAN S, WIEBE J, et al. Feature subsumption for opinion analysis［C］//Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). Stroudsburg, PA, USA， 2006:440448.
［6］HATZIVASSILOGLOU V, WIEBE J. Effects of adjective orientation and gradability on sentence subjectivity［C］//Proceedings of the International Conference on Computational Linguistics (COLING). Saarbrücken, Germany, 2000: 299305.
［7］XIA R， ZONG C Q. Exploring the use of word relation features for sentiment classification［C］//Proceedings of the 23rd International Conference on Computational Linguistics (COLING). Beijing, China, 2010: 13361344.
［8］XIA R， ZONG C Q. A POSbased ensemble model for crossdomain sentiment classification［C］//Proceedings of the International Joint Conference on Natural Language Processing (IJCNLP). Chiang Mai, Thailand, 2011: 614622.
［9］GAMON M. Sentiment classification on customer feedback data: noisy data, large feature vectors, and the role of linguistic analysis［C］//Proceedings of the International Conference on Computational Linguistics (COLING). Barcelona, Spain, 2004： 841847.
［10］KENNEDY A, INKPEN D. Sentiment classification of movie reviews using contextual valence shifters［J］. Com〖LL〗putational Intelligence, 2006, 22: 110125.
［11］DAVE K. Mining the peanut gallery: opinion extraction and semantic classification of product reviews［C］//Proceedings of the International World Wide Web Conference (WWW). Budapest, Hungary, 2003: 519528.
［12］MCCALLUM A， NIGAM K. A comparison of event models for naive Bayes text classification［C］//Proceedings of the AAAI Workshop on Learning for Text Categorization. Madison, USA, 1998： 1518.
［13］JOACHIMS T. Text categorization with support vector machines: learning with many relevant features［C］//Chemnitz, Germany： Springer, 1998： 237243.
［14］KUDO T, MATSUMOTO Y. A boosting algorithm for classification of semistructured text［C］//Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).Barcelona, Spain, 2004：3541.
［15］BLITZER J. Biographies, bollywood, boomboxes and blenders: domain adaptation for sentiment classification［C］//Proceedings of the Association for Computational Linguistics (ACL). Prague, Czech Republic, 2007： 151156.
［16］YANG Y, PEDERSEN J. A comparative study on feature selection in text categorization［C］//Proceedings of the Fourteenth International Conference on Machine Learning (ICML). Nashville, USA, 1997: 412420.
- 相似文献/References:
-
[1]张志飞,苗夺谦.基于粗糙集的文本分类特征选择算法[J].智能系统学报,2009,4(5):453.[doi:10.3969/j.issn.1673-4785.2009.05.011]
ZHANG Zhi-fei,MIAO Duo-qian.Feature selection for text categorization based on rough set[J].CAAI Transactions on Intelligent Systems,2009,4():453.[doi:10.3969/j.issn.1673-4785.2009.05.011]
[2]沈高峰,谷淑敏.基于遗传算法优化综合启发式的中文网页特征提取[J].智能系统学报,2014,9(4):474.[doi:10.3969/j.issn.1673-4785.201305044]
SHEN Gaofeng,GU Shumin.Chinese Web page feature extraction by optimizing comprehensive heuristics based on GA[J].CAAI Transactions on Intelligent Systems,2014,9():474.[doi:10.3969/j.issn.1673-4785.201305044]
[3]郝洁,谢珺,苏婧琼,等.基于词加权LDA算法的无监督情感分类[J].智能系统学报,2016,11(4):539.[doi:10.11992/tis.201606007]
HAO Jie,XIE Jun,SU Jingqiong,et al.An unsupervised approach for sentiment classification based on weighted latent dirichlet allocation[J].CAAI Transactions on Intelligent Systems,2016,11():539.[doi:10.11992/tis.201606007]
[4]古丽娜孜·艾力木江,乎西旦·居马洪,孙铁利,等.基于支持向量的最近邻文本分类方法[J].智能系统学报,2018,13(5):799.[doi:10.11992/tis.201711007]
GULNAZ Alimjan,HURXIDA Jumahun,SUN Tieli,et al.The nearest neighbor text classification method based on support vector[J].CAAI Transactions on Intelligent Systems,2018,13():799.[doi:10.11992/tis.201711007]
[5]高庆吉,赵志华,徐达,等.语音情感识别研究综述[J].智能系统学报,2020,15(1):1.[doi:10.11992/tis.201904065]
GAO Qingji,ZHAO Zhihua,XU Da,et al.Review on speech emotion recognition research[J].CAAI Transactions on Intelligent Systems,2020,15():1.[doi:10.11992/tis.201904065]
[6]商显震,韩萌,王少峰,等.融合迁移学习和神经网络的皮肤病诊断方法[J].智能系统学报,2020,15(3):452.[doi:10.11992/tis.201811015]
SHANG Xianzhen,HAN Meng,WANG Shaofeng,et al.A skin diseases diagnosis method combining transfer learning and neural networks[J].CAAI Transactions on Intelligent Systems,2020,15():452.[doi:10.11992/tis.201811015]
[7]曾碧卿,韩旭丽,王盛玉,等.层次化双注意力神经网络模型的情感分析研究[J].智能系统学报,2020,15(3):460.[doi:10.11992/tis.201812017]
ZENG Biqing,HAN Xuli,WANG Shengyu,et al.Hierarchical double-attention neural networks for sentiment classification[J].CAAI Transactions on Intelligent Systems,2020,15():460.[doi:10.11992/tis.201812017]
[8]张恒,何文玢,何军,等.医学知识增强的肿瘤分期多任务学习模型[J].智能系统学报,2021,16(4):739.[doi:10.11992/tis.202010005]
ZHANG Heng,HE Wenbin,HE Jun,et al.Multi-task tumor stage learning model with medical knowledge enhancement[J].CAAI Transactions on Intelligent Systems,2021,16():739.[doi:10.11992/tis.202010005]
[9]张铭泉,周辉,曹锦纲.基于注意力机制的双BERT有向情感文本分类研究[J].智能系统学报,2022,17(6):1220.[doi:10.11992/tis.202112038]
ZHANG Mingquan,ZHOU Hui,CAO Jingang.Dual BERT directed sentiment text classification based on attention mechanism[J].CAAI Transactions on Intelligent Systems,2022,17():1220.[doi:10.11992/tis.202112038]
[10]程艳,胡建生,赵松华,等.融合Transformer和交互注意力网络的方面级情感分类模型[J].智能系统学报,2024,19(3):728.[doi:10.11992/tis.202303016]
CHENG Yan,HU Jiansheng,ZHAO Songhua,et al.Aspect-level sentiment classification model combining Transformer and interactive attention network[J].CAAI Transactions on Intelligent Systems,2024,19():728.[doi:10.11992/tis.202303016]
备注/Memo
收稿日期： 2011-05-12.
基金项目：国家自然科学基金项目资助项目（60975053）；中科院－爱丁堡皇家学会交流项目.
通信作者：夏睿.E-mail:rxia@nlpr.ia.ac.cn.
?作者简介：
夏睿，男，1981年生，博士，主要研究方向为模式识别、机器学习、自然语言处理和文本挖掘等.
宗成庆，男，1963年生，研究员，博士生导师，中科院自动化所模式识别国家重点实验室副主任.亚洲自然语言处理联合会（AFNLP）执行理事、国际学术期刊 IEEE Intelligent Systems 副主编、ACM Transactions on Asian Language Information Processing 副主编、International Journal of Computer Processing of Languages 副主编、Journal of Computer Science and Technology编委、《自动化学报》编委、中国中文信息学会常务理事、中国人工智能学会理事，并曾在若干国际学术会议（包括ACL、COLING等本领域顶级国际会议）上担任程序委员会及组织委员会主席、Area Chair、委员等职务.主要研究方向为自然语言处理的理论与方法、机器翻译、文本分类等.在大规模口语语料库建设、口语理解与翻译、文本机器翻译和自动分类等方面，提出了一系列新的技术和方法，多次在国际口语翻译权威评测中获得优异成绩.申请国家发明专利10余项。在国内外重要学术刊物和会议上发表学术论文70余篇，出版学术专著1部.
更新日期/Last Update:
2012-02-29