Super-resolution of remotely sensed data using channel attention based deep learning approacH

Wang P., Bayram B., Sertel E.

INTERNATIONAL JOURNAL OF REMOTE SENSING, vol.42, no.16, pp.6050-6067, 2021 (Journal Indexed in SCI)

  • Publication Type: Article / Article
  • Volume: 42 Issue: 16
  • Publication Date: 2021
  • Doi Number: 10.1080/01431161.2021.1934598
  • Page Numbers: pp.6050-6067


Remote Sensing image super-resolution aims to improve the spec- tral and/or spatial resolution of the satellite imageries. In order to improve the performance of the CNN-based super-resolution meth- ods, increasing the depth of the network is commonly used. However, this increases computational complexity and training difficulties only with small improvement of the performance. Meanwhile, the CNN kernels treat all the channels equally and cannot take the advantage of the abundant high-frequency infor- mation contained in the low-resolution images. To address these problems, Channel attention is one of the mechanisms and has been proven to be useful in many tasks. In this research, we pro- posed a channel attention-based framework for Remote Sensing Image Super-resolution (CARS) by constructing a novel residual channel attention block (RCAB) to further extract the features. In addition, a densely residual channel attention block (RCAB+) and densely residual spatial attention block (RSAB) were proposed to improve the performance. We adopted a post-upsampling archi- tecture to reduce the computational complexity and time cost. Moreover, transfer learning strategy (CARS+T) was introduced to further improve the SR performance and proved to generate finer edge details. Experimentally, our proposed CARS, CARS_SA and CARS+T achieved competitive quantitative and qualitative results both on Data Fusion Contest Dataset and Pleiades Dataset that we created.