On the extraction of training imagery from very large remote sensing datasets for deep convolutional segmenatation networks


Conference Paper

© 2018 IEEE. In this work, we investigate strategies for training convolutional neural networks (CNNs) to perform recognition on remote sensing imagery. In particular we consider the particular problem of semantic segmentation in which the goal is to obtain a dense pixel-wise labeling of the input imagery. Remote sensing imagery is usually stored in the form of very large images, called "tiles", which are too big to be segmented directly using most CNNs and their associated hardware. Therefore smaller sub-images, called "patches", must be extracted from the available tiles. A popular strategy in the literature is to randomly sample patches from the tiles. However, in this work we demonstrate experimentally that extracting patches randomly from a uniform, non-overlapping spatial grid, leads to more accurate models. Our findings suggest the performance improvements are the result of reducing redundancy within the training dataset. We also find that sampling mini-batches of patches (for stochastic gradient descent) using constraints that maximizes the diversity of images within each batch leads to more accurate models. For example, in this work we constrained patches to come from varying tiles, or cities. These simple strategies contributed to our winning entry (in terms of overall performance) in the first year of the INRIA Building Labeling Challenge.

Full Text

Duke Authors

Cited Authors

  • Huang, B; Reichman, D; Collins, LM; Bradbury, K; Malof, JM

Published Date

  • October 31, 2018

Published In

  • International Geoscience and Remote Sensing Symposium (Igarss)

Volume / Issue

  • 2018-July /

Start / End Page

  • 6895 - 6898

International Standard Book Number 13 (ISBN-13)

  • 9781538671504

Digital Object Identifier (DOI)

  • 10.1109/IGARSS.2018.8519523

Citation Source

  • Scopus