欢迎访问中国科学院大学学报,今天是
信息与电子科学

基于核函数原型和自适应遗传算法的 SVM模型选择方法

  • 陈刚 ,
  • 王宏琦 ,
  • 孙显
展开
  • 中国科学院电子学研究所空间信息处理与应用系统技术重点实验室, 北京 100190

收稿日期: 2010-11-26

  修回日期: 2011-01-28

  网络出版日期: 2012-01-15

基金资助

国家自然科学基金(41001285)资助

Model selection for SVM classification based on kernel prototype and adaptive genetic algorithm

  • CHEN Gang ,
  • WANG Hong-Qi ,
  • SUN Xian
Expand
  • Key Laboratory of Technology in Geo-spatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China

Received date: 2010-11-26

  Revised date: 2011-01-28

  Online published: 2012-01-15

摘要

针对现有SVM模型选择方法中人为指定核函数类型导致SVM模型性能难以达到最优的问题,提出了核函数原型的概念,并在此基础上提出一种基于核函数原型和自适应遗传算法的SVM模型选择方法. 该方法针对具体问题选择最优的核函数,有效地提高了SVM模型的性能;同时该方法通过动态调整遗传算法的控制参数,提高了SVM模型选择方法的稳定性. 在5个标准SVM数据集和遥感图像上的实验证明了该方法的有效性和稳定性.

本文引用格式

陈刚 , 王宏琦 , 孙显 . 基于核函数原型和自适应遗传算法的 SVM模型选择方法[J]. 中国科学院大学学报, 2012 , 29(1) : 62 -69 . DOI: 10.7523/j.issn.2095-6134.2012.1.009

Abstract

Model selection plays an important role in support of vector machine classification. We propose a concept of kernel prototype which means general kernel type. Based on this, a new algorithm for model selection for supporting vector machine classification is proposed. The powerful adaptive genetic algorithm is used to optimize the parameters in kernel prototype, and it can find the optimal kernel type as well as the kernel parameters. Experiments show effectiveness and stability of the algorithms.

参考文献


[1] Vapnik V N. An overview of statistical learning theory
[J]. IEEE Transactions on Neural Networks, 1999, 10(5): 988-999.

[2] Tong S, Koller D. Support vector machine active learning with applications to text classification
[J]. Journal of Machine Learning Researeh, 2002, 2: 45-66.

[3] Wu C H, Tzeng G H, Goo Y J, et al. A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy
[J]. Expert Systems with Applications, 2007, 32(2): 397-408.

[4] Ahn H, Lee K, Kim K J. Global optimization of support vector machines using genetic algorithms for bankruptcy prediction
[J]. Springer, Heidelberg Lecture Notes in Computer Science, 2006, 4234: 420-429.

[5] Lee M C. Using support vector machine with a hybrid feature selection method to the stock trend prediction
[J]. Expert Systems with Applications, 2009, 36(8): 10896-10904.

[6] Akay M F. Support vector machines combined with feature selection for breast cancer diagnosis
[J]. Expert Systems with Applications, 2009, 36(2): 3240-3247.

[7] Chang C Y, Chen S J, Tsai M F. Application of support-vector-machine-based method for feature selection and classification of thyroid nodules in ultrasound images
[J]. Pattern Recognition, 2010, 43: 3494-3506.

[8] Hsu C W,Chang C C,Lin C J. A practical guide to SVM classification .2003. .http://www.csie.ntu.edu.tw/~cjlin.

[9] Chapelle O, Vapnik V, Bousquet O, et al. Choose multiple parameters for support vector machine
[J]. Machine Learning, 2002, 46 (1): 131-159.

[10] Gold C, Sollich P. Model selection for support vector machine classification
[J]. Neurocomputing, 2003, 55(1-2): 221-249.

[11] Cawley G C. Model selection for support vector machines via adaptive step-size tabu search //Proceedings of the International Conference on Artificial Neural Networks and Genetic Algorithms. 2001: 434-437.

[12] Li S, Tan M. Tuning SVM parameters by using a hybrid CLPSO-BFGS algorithm
[J]. Neurocomputing, 2010, 73: 2089-2096.

[13] Friedrichs F, Igel C. Evolutionary tunning of multiple svm parameters
[J]. Neurocomputing, 2005, 64: 107-117.

[14] Huang C L, Wang C G. A GA-based feature selection and parameters optimization for support vector machines
[J]. Expert Systems with Application, 2006, 31: 231-240.

[15] Cristianini N, Taylor J S. An introduction to support vector machine and other kernel-based learning methods
[M]. Cambridge University Press, 2000: 42-43.

[16] Srinivas M, Patnaik L M. Adaptive probabilities of crossover and mutation in genetic algorithms
[J]. IEEE Transactions on System, Man and Cybernetics, 1994, 24(4): 656-667.

[17] Haralick R M, Shanmugan K, Dinstein I. Textural features for image classification
[J]. IEEE Transactions on System, Man and Cybernetics, 1973, 3(6): 610-621.

文章导航

/