Fusion of multispectral image and panchromatic image based on NSCT and NMF

A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform (NSCT) and non-negative matrix factorization (NMF) is presented, the aim of which is to preserve both spectral and spatial information simultaneously in fused image. NMF is a matrix factorization method, which can extract the local feature by choosing suitable dimension of the feature subspace. Firstly the multispectral image was represented in intensity hue saturation (IHS) system. Then the I component and panchromatic image were decomposed by NSCT. Next we used NMF to learn the feature of both multispectral and panchromatic images’ low-frequency subbands, and the selection principle of the other coefficients was absolute maximum criterion. Finally the new coefficients were reconstructed to get the fused image. Experiments are carried out and the results are compared with some other methods, which show that the new method performs better in improving the spatial resolution and preserving the feature information than the other existing relative methods.