Skip to main content

The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: An empirical study with solar array detection

Publication ,  Conference
Wang, R; Camilo, J; Collins, LM; Bradbury, K; Malof, JM
Published in: Proceedings - Applied Imagery Pattern Recognition Workshop
July 2, 2017

Convolutional neural networks (CNNs) have recently achieved unprecedented performance for the automatic recognition of objects (e.g., buildings, roads, or vehicles) in color aerial imagery. Although these results are promising, questions remain about their practical applicability. This is because there is a wide variability in the visual characteristics of remote sensing imagery across different geographic locations, and CNNs are often trained and tested on imagery from nearby (or the same) geographic locations. It is therefore unclear whether trained CNNs will perform well on new, previously unseen, geographic locations, which is an important practical consideration. In this work we investigate this problem when applying CNNs for solar array detection on a large aerial imagery dataset comprised of two nearby US cities. We compare the performance of CNNs under two conditions: Training and testing on the same city vs training on one city and testing on another city. We discuss several subtle difficulties with these experiments and make recommendations. We show that there can be substantial performance loss in second case, when compared to the first. We also investigate how much training data is required from the unseen city in order to fine-tune the CNN so that it performs well. We investigate several different fine-tuning strategies, yielding a clear winner.

Duke Scholars

Published In

Proceedings - Applied Imagery Pattern Recognition Workshop

DOI

ISSN

2164-2516

ISBN

9781538612354

Publication Date

July 2, 2017

Volume

2017-October
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Wang, R., Camilo, J., Collins, L. M., Bradbury, K., & Malof, J. M. (2017). The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: An empirical study with solar array detection. In Proceedings - Applied Imagery Pattern Recognition Workshop (Vol. 2017-October). https://doi.org/10.1109/AIPR.2017.8457965
Wang, R., J. Camilo, L. M. Collins, K. Bradbury, and J. M. Malof. “The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: An empirical study with solar array detection.” In Proceedings - Applied Imagery Pattern Recognition Workshop, Vol. 2017-October, 2017. https://doi.org/10.1109/AIPR.2017.8457965.
Wang R, Camilo J, Collins LM, Bradbury K, Malof JM. The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: An empirical study with solar array detection. In: Proceedings - Applied Imagery Pattern Recognition Workshop. 2017.
Wang, R., et al. “The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: An empirical study with solar array detection.” Proceedings - Applied Imagery Pattern Recognition Workshop, vol. 2017-October, 2017. Scopus, doi:10.1109/AIPR.2017.8457965.
Wang R, Camilo J, Collins LM, Bradbury K, Malof JM. The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: An empirical study with solar array detection. Proceedings - Applied Imagery Pattern Recognition Workshop. 2017.

Published In

Proceedings - Applied Imagery Pattern Recognition Workshop

DOI

ISSN

2164-2516

ISBN

9781538612354

Publication Date

July 2, 2017

Volume

2017-October