Deep metric learning with data summarization


Conference Paper

© Springer International Publishing AG 2016. We present Deep Stochastic Neighbor Compression (DSNC), a framework to compress training data for instance-based methods (such as k-nearest neighbors). We accomplish this by inferring a smaller set of pseudo-inputs in a new feature space learned by a deep neural network. Our framework can equivalently be seen as jointly learning a nonlinear distance metric (induced by the deep feature space) and learning a compressed version of the training data. In particular, compressing the data in a deep feature space makes DSNC robust against label noise and issues such as within-class multi-modal distributions. This leads to DSNC yielding better accuracies and faster predictions at test time, as compared to other competing methods. We conduct comprehensive empirical evaluations, on both quantitative and qualitative tasks, and on several benchmark datasets, to show its effectiveness as compared to several baselines.

Full Text

Duke Authors

Cited Authors

  • Wang, W; Chen, C; Chen, W; Rai, P; Carin, L

Published Date

  • January 1, 2016

Published In

Volume / Issue

  • 9851 LNAI /

Start / End Page

  • 777 - 794

Electronic International Standard Serial Number (EISSN)

  • 1611-3349

International Standard Serial Number (ISSN)

  • 0302-9743

International Standard Book Number 13 (ISBN-13)

  • 9783319461274

Digital Object Identifier (DOI)

  • 10.1007/978-3-319-46128-1_49

Citation Source

  • Scopus