Skip to main content

Neural Tangent Kernel Maximum Mean Discrepancy

Publication ,  Conference
Cheng, X; Xie, Y
Published in: Advances in Neural Information Processing Systems
January 1, 2021

We present a novel neural network Maximum Mean Discrepancy (MMD) statistic by identifying a new connection between neural tangent kernel (NTK) and MMD. This connection enables us to develop a computationally efficient and memory-efficient approach to compute the MMD statistic and perform NTK based two-sample tests towards addressing the long-standing challenge of memory and computational complexity of the MMD statistic, which is essential for online implementation to assimilating new samples. Theoretically, such a connection allows us to understand the NTK test statistic properties, such as the Type-I error and testing power for performing the two-sample test, by adapting existing theories for kernel MMD. Numerical experiments on synthetic and real-world datasets validate the theory and demonstrate the effectiveness of the proposed NTK-MMD statistic.

Duke Scholars

Published In

Advances in Neural Information Processing Systems

ISSN

1049-5258

ISBN

9781713845393

Publication Date

January 1, 2021

Volume

9

Start / End Page

6658 / 6670

Related Subject Headings

  • 4611 Machine learning
  • 1702 Cognitive Sciences
  • 1701 Psychology
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Cheng, X., & Xie, Y. (2021). Neural Tangent Kernel Maximum Mean Discrepancy. In Advances in Neural Information Processing Systems (Vol. 9, pp. 6658–6670).
Cheng, X., and Y. Xie. “Neural Tangent Kernel Maximum Mean Discrepancy.” In Advances in Neural Information Processing Systems, 9:6658–70, 2021.
Cheng X, Xie Y. Neural Tangent Kernel Maximum Mean Discrepancy. In: Advances in Neural Information Processing Systems. 2021. p. 6658–70.
Cheng, X., and Y. Xie. “Neural Tangent Kernel Maximum Mean Discrepancy.” Advances in Neural Information Processing Systems, vol. 9, 2021, pp. 6658–70.
Cheng X, Xie Y. Neural Tangent Kernel Maximum Mean Discrepancy. Advances in Neural Information Processing Systems. 2021. p. 6658–6670.

Published In

Advances in Neural Information Processing Systems

ISSN

1049-5258

ISBN

9781713845393

Publication Date

January 1, 2021

Volume

9

Start / End Page

6658 / 6670

Related Subject Headings

  • 4611 Machine learning
  • 1702 Cognitive Sciences
  • 1701 Psychology