Cross Parallax Attention Network for Stereo Image Super-Resolution

Chen, Canqiang, Qing, Chunmei, Xu, Xiangmin and Dickinson, Patrick (2021) Cross Parallax Attention Network for Stereo Image Super-Resolution. IEEE Transactions on Multimedia . ISSN 1520-9210

Full content URL:

Cross Parallax Attention Network for Stereo Image Super-Resolution
Authors' Accepted Manuscript
revised-manuscript.pdf - Whole Document

Item Type:Article
Item Status:Live Archive


Stereo super-resolution (SR) aims to enhance the spatial resolution of one camera view using additional information from the other. Previous deep-learning-based stereo SR methods indeed improved the SR performance effectively by employing additional information, but they are unable to superresolve stereo images where there are large disparities, or different types of epipolar lines. Moreover, in these methods, one model can only super-solve images of a particular view, and for one specific scale factor. This paper proposes a cross parallax attention stereo super-resolution network (CPASSRnet) which can perform stereo SR of multiple scale factors for both views, with a single model. To overcome the difficulties of large disparity and different types of epipolar lines, a cross parallax attention module (CPAM) is presented, which captures the global correspondence of additional information for each view, relative to the other. CPAM allows the two views to exchange additional information with each other according to the generated attention maps. Quantitative and qualitative results compared with the state of the arts illustrate the superiority of CPASSRnet. Ablation experiments demonstrate that the proposed components are effective and noise tests verify the robustness of CPASSRnet.

Keywords:Stereo super-resolution, Convolutional Neural Network
Subjects:G Mathematical and Computer Sciences > G400 Computer Science
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:43632
Deposited On:26 Jan 2021 11:10

Repository Staff Only: item control page