Skip to main content

Transformers For Recognition In Overhead Imagery: A Reality Check

Publication ,  Conference
Luzi, F; Gupta, A; Collins, L; Bradbury, K; Malof, J
Published in: Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023
January 1, 2023

There is evidence that transformers offer state-of-the-art recognition performance on tasks involving overhead imagery (e.g., satellite imagery). However, it is difficult to make unbiased empirical comparisons between competing deep learning models, making it unclear whether, and to what extent, transformer-based models are beneficial. In this paper we systematically compare the impact of adding transformer structures into state-of-the-art segmentation models for overhead imagery. Each model is given a similar budget of free parameters, and their hyperparameters are optimized using Bayesian Optimization with a fixed quantity of data and computation time. We conduct our experiments with a large and diverse dataset comprising two large public benchmarks: Inria and DeepGlobe. We perform additional ablation studies to explore the impact of specific transformer-based modeling choices. Our results suggest that transformers provide consistent, but modest, performance improvements. We only observe this advantage however in hybrid models that combine convolutional and transformer-based structures, while fully transformer-based models achieve relatively poor performance.

Duke Scholars

Published In

Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023

DOI

ISBN

9781665493468

Publication Date

January 1, 2023

Start / End Page

3767 / 3776
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Luzi, F., Gupta, A., Collins, L., Bradbury, K., & Malof, J. (2023). Transformers For Recognition In Overhead Imagery: A Reality Check. In Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023 (pp. 3767–3776). https://doi.org/10.1109/WACV56688.2023.00377
Luzi, F., A. Gupta, L. Collins, K. Bradbury, and J. Malof. “Transformers For Recognition In Overhead Imagery: A Reality Check.” In Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023, 3767–76, 2023. https://doi.org/10.1109/WACV56688.2023.00377.
Luzi F, Gupta A, Collins L, Bradbury K, Malof J. Transformers For Recognition In Overhead Imagery: A Reality Check. In: Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023. 2023. p. 3767–76.
Luzi, F., et al. “Transformers For Recognition In Overhead Imagery: A Reality Check.” Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023, 2023, pp. 3767–76. Scopus, doi:10.1109/WACV56688.2023.00377.
Luzi F, Gupta A, Collins L, Bradbury K, Malof J. Transformers For Recognition In Overhead Imagery: A Reality Check. Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023. 2023. p. 3767–3776.

Published In

Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023

DOI

ISBN

9781665493468

Publication Date

January 1, 2023

Start / End Page

3767 / 3776