Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Introduces PVT, a convolution-free pyramid Transformer backbone for dense prediction tasks like detection and segmentation.
The Pyramid Vision Transformer (PVT) is a convolution-free backbone for dense prediction, unlike ViT which targets image classification. A progressive shrinking pyramid lets PVT produce high-resolution outputs while reducing computation on large feature maps, and it inherits advantages of both CNNs and Transformers as a unified backbone that directly replaces CNN backbones. Across object detection, instance and semantic segmentation it boosts performance; PVT+RetinaNet reaches 40.4 AP on COCO, surpassing ResNet50+RetinaNet's 36.3 AP by 4.1 points.
Based on: Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions · IEEE International Conference on Computer Vision
Curated by Aramai Editorial
Read summary →