Edge and local energy NSCT based remote sensing image fusion

doi:10.7523/j.issn.2095-6134.2009.5.011

Abstract

Abstract:

Edge-based image fusion algorithm can not preserve energy structure which is important in indicating the reflection feature of the observed objects. This paper proposed an enhanced algorithm considering both edge and energy structures. Nonsubsampled contourlet transform is firstly deployed to analyze input image in both multi-scale and multi-direction sub-bands. Low frequency band is then divided into contour and smooth regions by edge energy. Edge energy is used as a fusion judgment for the contour region while local energy and correlation are selected as judgments for the smooth region. Local variance and correlation are chosen to merge the coefficients of high frequency sub-bands. Inverse NSCT transform is finally used to get the fused image. Experimental results show that the new algorithm is an effective method that introduces more detailed information while preserves power structure.

Key words: fusion, nonsubsampled contourlet, edge energy, salience measure

CLC Number:

TP75

WANG Jie-Xiong, QI Xiang-Yang, LI Xin-Wei. Edge and local energy NSCT based remote sensing image fusion[J]. , 2009, 26(5): 657-662.

References

[1] Minh N, Do M N D. The contourlet transform: an efficient directional multiresolution image representation
[J]. IEEE Transactions on Image Processing, 2005, 14(12): 2091-2106.

[2] Coifman R R, Donoho D L. Wavelets and statistics
[M]. New York: Springer-Verlag, 1995: 125-150.

[3] Cunha L D, Zhou J, Do M N. The nonsubsampled contourlet transform:theory, design, and applications
[J]. IEEE Transactions on Image Processing, 2006, 15(10): 3089-3101.

[4] Lian J, Wang K, Li G X. Edge-based image fusion algorithm with wavelet transform
[J].Journal on Communications, 2007,28(4):18-23(in Chinese). 连静, 王珂, 李光鑫. 基于边缘的小波图像融合算法
[J]. 通信学报, 2007, 28(4): 18-23.

[5] Simoncelli E P, Freeman W T. The steerable pyramid: A flexible architecture for multi-scale derivative computation //Proceedings of IEEE International Conference on Image Processing. Washington DC, 1995: 444-447.

[6] Meyer F G, Coifman R R. Brushlets: A tool for directional image analysis and image compression
[J]. Journal of Appl and Comput Harmonic Analysis, 1997, 5(4): 147-187.

[7] Kingsbury N. Complex wavelets for shift invariant analysis and filtering of signals
[J]. Journal of Appl and Comput Harmonic Analysis, 2001, 10: 234-253.

[8] Bamberger H R. A filter bank for the directional decomposition of images: theory and design
[J]. IEEE Transcations on Signal Processing, 1992, 40(4): 882-892.

[9] Burt P J, Kolczynski R J. Enhanced image capture through fusion . Proceedings Comput Vision, 1993, 173-182.

[10] Duncan D Y P, Do M N. Directional multiscale modeling of images using the contourlet transform
[J]. IEEE Transactions on Image Processing, 2003, 6(15): 1610-1620.

[11] Jing J J, Lü Q B, Zhou J S, et al. Research on the Assessment of Fusion Image
[J]. Acta Photonica Sinica, 2007,36(sup 1):313-317(in Chinese). 景娟娟,吕群波,周锦松,等. 图像融合效果评价方法研究
[J]. 光子学报, 2007, 36(增1): 313-317.

[12] Qu G H, Zhang D L, Yan P F. Information measure for performance of image fusion
[J]. Electronics Letters, 2002, 38(7): 313-315.

[13] Xydeas C, Petrovic V. Objective pixel-level image fusion performance measure
[J]. Proceedings of SPIE-The International Society for Optical Engineering, 2000, 4051: 89-98.

[1]	MENG Xiting, JI Luyan, ZHAO Yongchao, YANG Weitun. Multi-scale large well building object detection based on deep learning [J]. Journal of University of Chinese Academy of Sciences, 2021, 38(6): 800-808.
[2]	SHI Daheng, LIU Ligang, ZHOU Bin, BU Zhiyong. Fingerprinting localization of cross-temporal transferred and multi-source wireless signal fusion [J]. Journal of University of Chinese Academy of Sciences, 2021, 38(6): 817-824.
[3]	WANG Xiaohui, HU Yuxin, LÜ Peng. Multiple moving ships detection method based on saliency map fusion for GF-4 satellite remote sensing image [J]. Journal of University of Chinese Academy of Sciences, 2021, 38(5): 649-659.
[4]	WANG Hong, XU Youyu, TAN Chong, LIU Hong, ZHENG Min. Information fusion algorithm based on improved particle swarm BP neural network in WSN [J]. , 2020, 37(5): 673-680.
[5]	XING Xiaokai, Lü Zhaoxu, LIU Jiaquan. Study on mixed flow and initial deposition characteristics of extra-high water-cut crude oil [J]. , 2020, 37(2): 228-233.
[6]	MA Xiaoxiao, CHENG Bo, LIU Yueming, CUI Shiai, LIANG Chenbin. PolSAR remote sensing image method for building extraction based on polarization and texture characteristics [J]. , 2019, 36(5): 682-693.
[7]	YU Chong, GUO Lu. Role of the Skyrme tensor force in heavy-ion collision [J]. , 2018, 35(4): 457-462.
[8]	WANG Chao, CHEN Xue, XU Ruina, JIANG Peixue. Water film heating evaporation under low pressure [J]. , 2018, 35(2): 188-192.
[9]	HOU Yangyang, XU Tiange. A restricted B-spline estimation of diffusion processes with applications to financial data [J]. , 2018, 35(1): 10-17.
[10]	YE Lei, DUAN Xuejun, OU Xiangjun. Functional polycentricity in Yangtze River delta based on social network analysis [J]. , 2016, 33(1): 75-81.
[11]	CHEN Zhenfeng, YANG Xiaohao, WU Weilan, LIU Jia, XIA Shanhong. Design and implementation of mandarin spoken dialogue system for flight reservation [J]. , 2015, 32(2): 252-258.
[12]	DU Yue-Fei, YU Xin-Gang, LIU Jie, ZHANG Nian-Mei. Thermal deformation of FCI under magnetic confinement nuclear fusion environment [J]. , 2013, 30(6): 737-743.
[13]	YU Chong. Omni-directional stepping robotic system based on cellular grid map [J]. Journal of University of Chinese Academy of Sciences, 2013, 30(3): 394-402.
[14]	LIN Wen-Xian. Oscillation of a class of even-order neutral partial functional differential equations with continuous deviating arguments and diffusion coefficients [J]. , 2012, (6): 738-742.
[15]	ZHANG Tao, ZHAO Xian-Feng, HUANG Wei, SHENG Ren-Nong. Analysis of complementarity among three sets of the features and their fusion for spatial steganography [J]. , 2012, (2): 264-270.