Welcome to Journal of University of Chinese Academy of Sciences,Today is

Heterogeneous transfer learning based on translation invariant kernels

  • GUAN Zengda ,
  • CHENG Li ,
  • ZHU Tingshao
Expand
  • 1. School of Computer and Control, University of Chinese Academy of Sciences, Beijing 101408, China;
    2. Bioinformatics Institute, A*STAR, Singapore 138671;
    3. School of Computing, National University of Singapore, Singapore 119077;
    4. Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China

Received date: 2013-12-25

  Revised date: 2014-03-19

  Online published: 2015-01-15

Abstract

We propose a new heterogeneous transfer learning method, which uses related heterogeneous feature dataset. We use translation invariant kernels(Euclidean kernels and RBF kernels) to map the target dataset and the related dataset to a new reproducing kernel Hilbert space, in which the two datasets have equal feature dimensions and similar distributions and reserve their topological property. The experimental results show that our method works well and the method based on the Euclidean kernel improves accuracy by more than 5%~10%.

Cite this article

GUAN Zengda , CHENG Li , ZHU Tingshao . Heterogeneous transfer learning based on translation invariant kernels[J]. Journal of University of Chinese Academy of Sciences, 2015 , 32(1) : 121 -126 . DOI: 10.7523/j.issn.2095-6134.2015.01.020

References

[1] Pan S J, Yang Q. A survey on transfer learning[J].IEEE Transactions on Knowledge and Data Engineering , 2010,22(10):1 345-1 359.

[2] Yang Q, Chen Y, Xue G, et al. Heterogeneous transfer learning for image clustering via the social web[C]//Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLP. Suntec, Singapore, 2009:1-9.

[3] Zhu Y, Chen Y, Lu Z, et al. Heterogeneous transfer learning for image classification[C]//Proceedings of the 25th AAAI Conference on Artificial Intelligence. San Francisco,USA, 2011:1 304-1 309.

[4] Dai W Y, Chen Y Q, Xue G R, et al. Translated learning: transfer learning across different feature spaces[C]//Proc 21st Ann Conf Neural Information Processing Systems. Vancouver, Canada, 2008.

[5] Wang C, Mahadevan S. Heterogeneous domain adaptation using manifold alignment[C]//Proc 22nd International Joint Conference on Artificial Intelligence. Barcelona, Spain, 2011: 1 541-1 546.

[6] Duan L, Xu D, Tsang I W. Learning with augmented features for heterogeneous domain adaptation[C]//Proceedings of the 29th International Conference on Machine Learning. Edinburgh, Scotland, UK, 2012.

[7] Kulis B, Saenko K, Darrell T. What you saw is not what you get: domain adaptation using asymmetric kernel transforms[C]//Computer Vision and Pattern Recognition, Colorado. USA, 2011: 1 785-1 792.

[8] Guan Z D, Bai S B, Zhu T S. Heterogeneous domain adaptation using linear kernel[C]//ICPCA-SWS. Vina del Mar, Chile, Springer, 2013.

[9] Gu Q Q, Li Z H, Han J W. Learning a kernel for multi-task clustering[C]//Proceedings of the 25th AAAI Conference on Artificial Intelligence. San Francisco, USA, 2011.

[10] Pan S J, Tsang I W, Kwok J T, et al. Domain adaptation via transfer component analysis[J]. IEEE Transactions on Neural Networks, 2011, 22(2):199-210.

[11] Gretton A, Borgwardt K M, Rasch M J, et al. A kernel method for the two-sample-problem[C]//Proceedings of the 2006 Conference Advances in Neural Information Processing Systems 19. Vancouver, Canada, MIT Press, 2006, 20:513-520.

Outlines

/