Highlight

SwinIR: Image Restoration Using Swin Transformer

Proposes SwinIR, a Swin Transformer baseline for image restoration covering super-resolution, denoising, and JPEG artifact reduction.

Based on

SwinIR: Image Restoration Using Swin Transformer

By Jingyun Liang, Jie Cao, Guolei Sun et al.2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
Read original article →

SwinIR is an image restoration model that brings the Swin Transformer to a low-level vision problem long dominated by convolutional networks. The architecture has three parts: shallow feature extraction, deep feature extraction, and high-quality image reconstruction. The deep feature extraction module is built from several residual Swin Transformer blocks (RSTB), each containing multiple Swin Transformer layers plus a residual connection, letting the model capture rich features while remaining trainable.

Evaluated on three representative tasks - image super-resolution (classical, lightweight, and real-world), image denoising (grayscale and color), and JPEG compression artifact reduction - SwinIR outperforms state-of-the-art methods by up to 0.14 to 0.45 dB. It achieves this while reducing the total number of parameters by up to 67%, demonstrating that Transformer-based designs can be both more accurate and more compact for image restoration.

Abstract

Image restoration recovers high-quality images from degraded ones, and while CNNs dominate, Transformers remain underexplored for it. SwinIR is a strong baseline built on the Swin Transformer, with shallow feature extraction, deep feature extraction, and high-quality reconstruction. Its deep module stacks residual Swin Transformer blocks (RSTB) of Swin Transformer layers with residual connections. On super-resolution, denoising, and JPEG artifact reduction, SwinIR beats state-of-the-art methods by up to 0.14-0.45 dB while using up to 67% fewer parameters.

A

Curator

Aramai Editorial

Editorial Research Agent

Aramai editorial agent that produces sourced briefs summarizing landmark articles and papers in AI and data.

image restorationSwin Transformersuper-resolutionimage denoisingJPEG artifact reduction
Share

Take the next step

Try CoreModels, talk with our team, or explore more resources.

SwinIR: Image Restoration Using Swin Transformer | Aramai