欢迎访问中国科学院大学学报,今天是
计算机科学

基于平移不变核的异构迁移学习

  • 关增达 ,
  • 程立 ,
  • 朱廷劭
展开
  • 1. 中国科学院大学计算机与控制学院, 北京 101408;
    2. 新加坡科技研究局生物信息研究所, 新加坡 138671;
    3. 新加坡国立大学计算机学院, 新加坡 119077;
    4. 中国科学院心理研究所, 北京 100101

收稿日期: 2013-12-25

  修回日期: 2014-03-19

  网络出版日期: 2015-01-15

基金资助

国家重点基础研究发展(973)计划(2014CB744600)、中国科学院重点项目(KJZD-EW-L04)、中国科学院战略性先导科技专项(XDA06030800)资助

Heterogeneous transfer learning based on translation invariant kernels

  • GUAN Zengda ,
  • CHENG Li ,
  • ZHU Tingshao
Expand
  • 1. School of Computer and Control, University of Chinese Academy of Sciences, Beijing 101408, China;
    2. Bioinformatics Institute, A*STAR, Singapore 138671;
    3. School of Computing, National University of Singapore, Singapore 119077;
    4. Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China

Received date: 2013-12-25

  Revised date: 2014-03-19

  Online published: 2015-01-15

摘要

提出一种新的异构迁移学习方法.利用与目标数据集相关的异构特征数据集.通过把目标集和异构集的数据使用平移不变核(欧式距离核和径向基函数核),映射到一个新的再生核希尔伯特空间上.在新空间中2个数据集的特征相同,特征维度相等,分布接近,且保持数据的拓扑性质不变.实验证明,该方法特别是基于欧式距离核的方法取得了较好的效果,在目标训练集的标注数据较少时,有大于5%甚至超过10%的精度提高.

本文引用格式

关增达 , 程立 , 朱廷劭 . 基于平移不变核的异构迁移学习[J]. 中国科学院大学学报, 2015 , 32(1) : 121 -126 . DOI: 10.7523/j.issn.2095-6134.2015.01.020

Abstract

We propose a new heterogeneous transfer learning method, which uses related heterogeneous feature dataset. We use translation invariant kernels(Euclidean kernels and RBF kernels) to map the target dataset and the related dataset to a new reproducing kernel Hilbert space, in which the two datasets have equal feature dimensions and similar distributions and reserve their topological property. The experimental results show that our method works well and the method based on the Euclidean kernel improves accuracy by more than 5%~10%.

参考文献

[1] Pan S J, Yang Q. A survey on transfer learning[J].IEEE Transactions on Knowledge and Data Engineering , 2010,22(10):1 345-1 359.

[2] Yang Q, Chen Y, Xue G, et al. Heterogeneous transfer learning for image clustering via the social web[C]//Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLP. Suntec, Singapore, 2009:1-9.

[3] Zhu Y, Chen Y, Lu Z, et al. Heterogeneous transfer learning for image classification[C]//Proceedings of the 25th AAAI Conference on Artificial Intelligence. San Francisco,USA, 2011:1 304-1 309.

[4] Dai W Y, Chen Y Q, Xue G R, et al. Translated learning: transfer learning across different feature spaces[C]//Proc 21st Ann Conf Neural Information Processing Systems. Vancouver, Canada, 2008.

[5] Wang C, Mahadevan S. Heterogeneous domain adaptation using manifold alignment[C]//Proc 22nd International Joint Conference on Artificial Intelligence. Barcelona, Spain, 2011: 1 541-1 546.

[6] Duan L, Xu D, Tsang I W. Learning with augmented features for heterogeneous domain adaptation[C]//Proceedings of the 29th International Conference on Machine Learning. Edinburgh, Scotland, UK, 2012.

[7] Kulis B, Saenko K, Darrell T. What you saw is not what you get: domain adaptation using asymmetric kernel transforms[C]//Computer Vision and Pattern Recognition, Colorado. USA, 2011: 1 785-1 792.

[8] Guan Z D, Bai S B, Zhu T S. Heterogeneous domain adaptation using linear kernel[C]//ICPCA-SWS. Vina del Mar, Chile, Springer, 2013.

[9] Gu Q Q, Li Z H, Han J W. Learning a kernel for multi-task clustering[C]//Proceedings of the 25th AAAI Conference on Artificial Intelligence. San Francisco, USA, 2011.

[10] Pan S J, Tsang I W, Kwok J T, et al. Domain adaptation via transfer component analysis[J]. IEEE Transactions on Neural Networks, 2011, 22(2):199-210.

[11] Gretton A, Borgwardt K M, Rasch M J, et al. A kernel method for the two-sample-problem[C]//Proceedings of the 2006 Conference Advances in Neural Information Processing Systems 19. Vancouver, Canada, MIT Press, 2006, 20:513-520.

文章导航

/