Skip to main content

Mask Embedding for Realistic High-Resolution Medical Image Synthesis

Publication ,  Conference
Ren, Y; Zhu, Z; Li, Y; Kong, D; Hou, R; Grimm, LJ; Marks, JR; Lo, JY
Published in: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
January 1, 2019

Generative Adversarial Networks (GANs) have found applications in natural image synthesis and begin to show promises generating synthetic medical images. In many cases, the ability to perform controlled image synthesis using masked priors such as shape and size of organs is desired. However, mask-guided image synthesis is challenging due to the pixel level mask constraint. While the few existing mask-guided image generation approaches suffer from the lack of fine-grained texture details, we tackle the issue of mask-guided stochastic image synthesis via mask embedding. Our novel architecture first encodes the input mask as an embedding vector and then inject these embedding into the random latent vector input. The intuition is to classify semantic masks into partitions before feature up-sampling for improved sample space mapping stability. We validate our approach on a large dataset containing 39,778 patients with 443,556 negative screening Full Field Digital Mammography (FFDM) images. Experimental results show that our approach can generate realistic high-resolution (256 × 512 ) images with pixel-level mask constraints, and outperform other state-of-the-art approaches.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

DOI

EISSN

1611-3349

ISSN

0302-9743

ISBN

9783030322250

Publication Date

January 1, 2019

Volume

11769 LNCS

Start / End Page

422 / 430

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 46 Information and computing sciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Ren, Y., Zhu, Z., Li, Y., Kong, D., Hou, R., Grimm, L. J., … Lo, J. Y. (2019). Mask Embedding for Realistic High-Resolution Medical Image Synthesis. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 11769 LNCS, pp. 422–430). https://doi.org/10.1007/978-3-030-32226-7_47
Ren, Y., Z. Zhu, Y. Li, D. Kong, R. Hou, L. J. Grimm, J. R. Marks, and J. Y. Lo. “Mask Embedding for Realistic High-Resolution Medical Image Synthesis.” In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 11769 LNCS:422–30, 2019. https://doi.org/10.1007/978-3-030-32226-7_47.
Ren Y, Zhu Z, Li Y, Kong D, Hou R, Grimm LJ, et al. Mask Embedding for Realistic High-Resolution Medical Image Synthesis. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2019. p. 422–30.
Ren, Y., et al. “Mask Embedding for Realistic High-Resolution Medical Image Synthesis.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11769 LNCS, 2019, pp. 422–30. Scopus, doi:10.1007/978-3-030-32226-7_47.
Ren Y, Zhu Z, Li Y, Kong D, Hou R, Grimm LJ, Marks JR, Lo JY. Mask Embedding for Realistic High-Resolution Medical Image Synthesis. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2019. p. 422–430.

Published In

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

DOI

EISSN

1611-3349

ISSN

0302-9743

ISBN

9783030322250

Publication Date

January 1, 2019

Volume

11769 LNCS

Start / End Page

422 / 430

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 46 Information and computing sciences