[1]QIAN Dong,WANG Bei,ZHANG Tao,et al.Classification algorithm based on Copula theory and Bayesian decision theory[J].CAAI Transactions on Intelligent Systems,2016,11(1):78-83.[doi:10.11992/tis.201509011]
Copy

Classification algorithm based on Copula theory and Bayesian decision theory

CAAI Transactions on Intelligent Systems[ISSN 1673-4785/CN 23-1538/TP] Volume: 11 Number of periods: 2016 1 Page number: 78-83 Column: 学术论文—机器学习 Public date: 2016-02-25
Title:
Classification algorithm based on Copula theory and Bayesian decision theory
Author(s):
QIAN Dong1;  WANG Bei1;  ZHANG Tao2;  WANG Xingyu1
1. School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China;
2. Department of Automation, Tsinghua University, Beijing 100086, China
Keywords:
machine learning; Bayesian decision theory; Copula theory; kernel density estimation; physiological signals
CLC:
TP391.4
DOI:
10.11992/tis.201509011
Abstract:
Traditional Bayesian decision classification algorithm is easily affected by the estimation of class-conditional probability densities, a fact that may result in incorrect classification results. Therefore, this paper proposes an improved classification algorithm based on Bayesian decision, i.e., Bayesian-Copula Discriminant Classifier (BCDC). This method constructs class-conditional probability densities by combining Copula theory and kernel density estimation instead of making assumptions on the form of class-conditional probability densities. Kernel density estimation is used to smooth the probability distribution of each feature. By performing probability integral transform, continuous distribution is converted to random variables having a uniform distribution. Then, Copula functions are used to construct the dependency structure between these probability distributions for two categories. Moreover, the maximum likelihood estimation is applied to determine the parameters of Copula functions, and two well-fitted Copula functions for two categories are selected based on Bayesian information criterion. The BCDC method was validated with experimental datasets of physiological signals. The obtained results showed that the proposed method outperforms other traditional methods in terms of classification accuracy and AUC as well as robustness. Moreover, it takes full advantage of Copula theory and kernel density estimation and improves the accuracy and flexibility of the estimation.
References:
[1] TIPPING M E. Sparse Bayesian learning and the relevance vector machine[J]. Journal of machine learning research, 2001, 1(3):211-244.
[2] XUE Jinghao, HALL P. Why does rebalancing class-unbalanced data improve AUC for linear discriminant analysis?[J]. IEEE transactions on pattern analysis and machine intelligence, 2015, 37(5):1109-1112.
[3] FERNáNDEZ-DELGADO M, CERNADAS E, BARRO S, et al. Do we need hundreds of classifiers to solve real world classification problems?[J]. Journal of machine learning research, 2014, 15(1):3133-3181.
[4] RODRIGUEZ A, LAIo A. Clustering by fast search and find of density peaks[J]. Science, 2014, 344(6191):1492-1496.
[5] 李宏伟, 刘扬, 卢汉清, 等. 结合半监督核的高斯过程分类[J]. 自动化学报, 2009, 35(7):888-895. LI Hongwei, LIU Yang, LU Hanqing, et al. Gaussian processes classification combined with semi-supervised kernels[J]. Acta automatica sinica, 2009, 35(7):888-895.
[6] BLEI D M, NG A Y, JORDAN M I. Latent dirichlet allocation[J]. Journal of machine learning research, 2001, 3(4-5):993-1022.
[7] BISHOP C M. Pattern Recognition and Machine Learning[M]. New York:Springer, 2006:21-31.
[8] NG A Y, JORDAN M I. On discriminative vs. generative classifiers:a comparison of logistic regression and na?ve Bayes[C]//Advances in Neural Information Processing Systems. Vancouver, British Columbia, Canada, 2002, 14:841-848.
[9] 李航. 统计学习方法[M]. 北京:清华大学出版社, 2012:77-91.
[10] JAIN A K, DUIN R P W, MAO Jianchang. Statistical pattern recognition:a review[J]. IEEE transactions on pattern analysis and machine intelligence, 2000, 22(1):4-37.
[11] DUDA R O, HART P E, STORK D G. Pattern Classification[M]. 2nd ed. New York:Wiley, 2001:20-45.
[12] MURPHY K P. Machine Learning:A Probabilistic Perspective[M]. England:MIT, 2012:82-87.
[13] NELSEN R B. An Introduction to Copulas[M]. 2nd ed. Springer:Berlin, 2006.
[14] GENEST C, FAVRE A C. Everything you always wanted to know about Copula modeling but were afraid to ask[J]. Journal of hydrologic engineering, 2007, 12(4):347-368.
[15] EBAN E, ROTHSCHILD G, MIZRAHI A, et al. Dynamic Copula networks for modeling real-valued time series[C]//Proceedings of the 16th International Conference on Artificial Intelligence and Statistics. Scottsdale, AZ, USA, 2013, 4:247-255.
[16] KRISTAN M, LEONARDIS A, SKOC AJ D. Multivariate online kernel density estimation with Gaussian kernels[J]. Pattern recognition, 2011, 44(10-11):2630-2642.
[17] CHERUBINI U, LUCIANO E, VECCHIATO W. Copula Methods in Finance[M]. England:John Wiley & Sons, 2004.
[18] PATTON A J. A review of Copula models for economic time series[J]. Journal of multivariate analysis, 2012, 110:4-18.
[19] AUBASI A. Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders[J]. Computers in biology and medicine, 2013, 43(5):576-586.
[20] TAGLUK M E, SEZGIN N, AKIN M. Estimation of sleep stages by an artificial neural network employing EEG, EMG and EOG[J]. Journal of medical systems, 2010, 34(4):717-725.
[21] CICHOCKI A, MANDIC D, DE LATHAUWER L, et al. Tensor decompositions for signal processing applications:from two-way to multiway component analysis[J]. IEEE signal processing, 2015, 32(2):145-163.
[22] KHUSHABA R N, KODAGODA S, LAL S, et al. Driver drowsiness classification using fuzzy wavelet-packet-based feature-extraction algorithm[J]. IEEE transactions on biomedical engineering, 2011, 58(1):121-131.
Similar References:

Memo

-

Last Update: 1900-01-01

Copyright © CAAI Transactions on Intelligent Systems