Learning spatial and spectral features via 2D-1D generative adversarial network for hyperspectral image super-resolution

Jiang, Ruituo, Li, Xu, Mei, Shaohui , Yue, Shigang and Zhang, Lei (2019) Learning spatial and spectral features via 2D-1D generative adversarial network for hyperspectral image super-resolution. In: 2019 IEEE International Conference on Image Processing (ICIP2019).

Full content URL: https://doi.org/10.1109/ICIP.2019.8803200

Documents
Learning spatial and spectral features via 2D-1D generative adversarial network for hyperspectral image super-resolution
Accepted Manuscript
[img]
[Download]
[img]
Preview
PDF
20190512 ICIP2019 Paper_1921 SV.pdf - Whole Document

2MB
Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive

Abstract

Three-dimensional (3D) convolutional networks have been proven to be able to explore spatial context and spectral information simultaneously for super-resolution (SR). However, such kind of network can’t be practically designed very
‘deep’ due to the long training time and GPU memory limitations involved in 3D convolution. Instead, in this paper, spatial context and spectral information in hyperspectral images (HSIs) are explored using Two-dimensional (2D) and Onedimenional (1D) convolution, separately. Therefore, a novel 2D-1D generative adversarial network architecture (2D-1DHSRGAN) is proposed for SR of HSIs. Specifically, the generator network consists of a spatial network and a spectral network, in which spatial network is trained with the least absolute deviations loss function to explore spatial context by 2D convolution and spectral network is trained with the spectral angle mapper (SAM) loss function to extract spectral information by 1D convolution. Experimental results over two real HSIs demonstrate that the proposed 2D-1D-HSRGAN clearly outperforms several state-of-the-art algorithms.

Keywords:Hyperspectral images, super-resolution, generative adversarial network
Subjects:G Mathematical and Computer Sciences > G740 Computer Vision
Divisions:College of Science > School of Computer Science
ID Code:42330
Deposited On:29 Oct 2020 13:35

Repository Staff Only: item control page