Skip to main content
Journal cover image

Deep metric learning with data summarization

Publication ,  Conference
Wang, W; Chen, C; Chen, W; Rai, P; Carin, L
Published in: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
January 1, 2016

We present Deep Stochastic Neighbor Compression (DSNC), a framework to compress training data for instance-based methods (such as k-nearest neighbors). We accomplish this by inferring a smaller set of pseudo-inputs in a new feature space learned by a deep neural network. Our framework can equivalently be seen as jointly learning a nonlinear distance metric (induced by the deep feature space) and learning a compressed version of the training data. In particular, compressing the data in a deep feature space makes DSNC robust against label noise and issues such as within-class multi-modal distributions. This leads to DSNC yielding better accuracies and faster predictions at test time, as compared to other competing methods. We conduct comprehensive empirical evaluations, on both quantitative and qualitative tasks, and on several benchmark datasets, to show its effectiveness as compared to several baselines.

Duke Scholars

Published In

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

DOI

EISSN

1611-3349

ISSN

0302-9743

ISBN

9783319461274

Publication Date

January 1, 2016

Volume

9851 LNAI

Start / End Page

777 / 794

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 46 Information and computing sciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Wang, W., Chen, C., Chen, W., Rai, P., & Carin, L. (2016). Deep metric learning with data summarization. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9851 LNAI, pp. 777–794). https://doi.org/10.1007/978-3-319-46128-1_49
Wang, W., C. Chen, W. Chen, P. Rai, and L. Carin. “Deep metric learning with data summarization.” In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9851 LNAI:777–94, 2016. https://doi.org/10.1007/978-3-319-46128-1_49.
Wang W, Chen C, Chen W, Rai P, Carin L. Deep metric learning with data summarization. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2016. p. 777–94.
Wang, W., et al. “Deep metric learning with data summarization.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9851 LNAI, 2016, pp. 777–94. Scopus, doi:10.1007/978-3-319-46128-1_49.
Wang W, Chen C, Chen W, Rai P, Carin L. Deep metric learning with data summarization. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2016. p. 777–794.
Journal cover image

Published In

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

DOI

EISSN

1611-3349

ISSN

0302-9743

ISBN

9783319461274

Publication Date

January 1, 2016

Volume

9851 LNAI

Start / End Page

777 / 794

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 46 Information and computing sciences