Skip to main content

GAN memory with no forgetting

Publication ,  Conference
Cong, Y; Zhao, M; Li, J; Wang, S; Carin, L
Published in: Advances in Neural Information Processing Systems
January 1, 2020

As a fundamental issue in lifelong learning, catastrophic forgetting is directly caused by inaccessible historical data; accordingly, if the data (information) were memorized perfectly, no forgetting should be expected. Motivated by that, we propose a GAN memory for lifelong learning, which is capable of remembering a stream of datasets via generative processes, with no forgetting. Our GAN memory is based on recognizing that one can modulate the “style” of a GAN model to form perceptually-distant targeted generation. Accordingly, we propose to do sequential style modulations atop a well-behaved base GAN model, to form sequential targeted generative models, while simultaneously benefiting from the transferred base knowledge. The GAN memory – that is motivated by lifelong learning – is therefore itself manifested by a form of lifelong learning, via forward transfer and modulation of information from prior tasks. Experiments demonstrate the superiority of our method over existing approaches and its effectiveness in alleviating catastrophic forgetting for lifelong classification problems. Code is available at https://github.com/MiaoyunZhao/GANmemory_LifelongLearning.

Duke Scholars

Published In

Advances in Neural Information Processing Systems

ISSN

1049-5258

Publication Date

January 1, 2020

Volume

2020-December

Related Subject Headings

  • 4611 Machine learning
  • 1702 Cognitive Sciences
  • 1701 Psychology
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Cong, Y., Zhao, M., Li, J., Wang, S., & Carin, L. (2020). GAN memory with no forgetting. In Advances in Neural Information Processing Systems (Vol. 2020-December).
Cong, Y., M. Zhao, J. Li, S. Wang, and L. Carin. “GAN memory with no forgetting.” In Advances in Neural Information Processing Systems, Vol. 2020-December, 2020.
Cong Y, Zhao M, Li J, Wang S, Carin L. GAN memory with no forgetting. In: Advances in Neural Information Processing Systems. 2020.
Cong, Y., et al. “GAN memory with no forgetting.” Advances in Neural Information Processing Systems, vol. 2020-December, 2020.
Cong Y, Zhao M, Li J, Wang S, Carin L. GAN memory with no forgetting. Advances in Neural Information Processing Systems. 2020.

Published In

Advances in Neural Information Processing Systems

ISSN

1049-5258

Publication Date

January 1, 2020

Volume

2020-December

Related Subject Headings

  • 4611 Machine learning
  • 1702 Cognitive Sciences
  • 1701 Psychology