Skip to main content

Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics.

Publication ,  Journal Article
Zhang, J; Saha, A; Zhu, Z; Mazurowski, MA
Published in: IEEE Trans Med Imaging
February 2019

Breast tumor segmentation based on dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is a challenging problem and an active area of research. Particular challenges, similarly as in other segmentation problems, include the class-imbalance problem as well as confounding background in DCE-MR images. To address these issues, we propose a mask-guided hierarchical learning (MHL) framework for breast tumor segmentation via fully convolutional networks (FCN). Specifically, we first develop an FCN model to generate a 3D breast mask as the region of interest (ROI) for each image, to remove confounding information from input DCE-MR images. We then design a two-stage FCN model to perform coarse-to-fine segmentation for breast tumors. Particularly, we propose a Dice-Sensitivity-like loss function and a reinforcement sampling strategy to handle the class-imbalance problem. To precisely identify locations of tumors that underwent a biopsy, we further propose an FCN model to detect two landmarks located at two nipples. We finally selected the biopsied tumor based on both identified landmarks and segmentations. We validate our MHL method on 272 patients, achieving a mean Dice similarity coefficient (DSC) of 0.72 which is comparable to mutual DSC between expert radiologists. Using the segmented biopsied tumors, we also demonstrate that the automatically generated masks can be applied to radiogenomics and can identify luminal A subtype from other molecular subtypes with the similar accuracy with the analysis based on semi-manual tumor segmentation.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

IEEE Trans Med Imaging

DOI

EISSN

1558-254X

Publication Date

February 2019

Volume

38

Issue

2

Start / End Page

435 / 447

Location

United States

Related Subject Headings

  • Nuclear Medicine & Medical Imaging
  • Neural Networks, Computer
  • Magnetic Resonance Imaging
  • Image Interpretation, Computer-Assisted
  • Humans
  • Genomics
  • Female
  • Breast Neoplasms
  • 46 Information and computing sciences
  • 40 Engineering
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Zhang, J., Saha, A., Zhu, Z., & Mazurowski, M. A. (2019). Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics. IEEE Trans Med Imaging, 38(2), 435–447. https://doi.org/10.1109/TMI.2018.2865671
Zhang, Jun, Ashirbani Saha, Zhe Zhu, and Maciej A. Mazurowski. “Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics.IEEE Trans Med Imaging 38, no. 2 (February 2019): 435–47. https://doi.org/10.1109/TMI.2018.2865671.
Zhang J, Saha A, Zhu Z, Mazurowski MA. Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics. IEEE Trans Med Imaging. 2019 Feb;38(2):435–47.
Zhang, Jun, et al. “Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics.IEEE Trans Med Imaging, vol. 38, no. 2, Feb. 2019, pp. 435–47. Pubmed, doi:10.1109/TMI.2018.2865671.
Zhang J, Saha A, Zhu Z, Mazurowski MA. Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics. IEEE Trans Med Imaging. 2019 Feb;38(2):435–447.

Published In

IEEE Trans Med Imaging

DOI

EISSN

1558-254X

Publication Date

February 2019

Volume

38

Issue

2

Start / End Page

435 / 447

Location

United States

Related Subject Headings

  • Nuclear Medicine & Medical Imaging
  • Neural Networks, Computer
  • Magnetic Resonance Imaging
  • Image Interpretation, Computer-Assisted
  • Humans
  • Genomics
  • Female
  • Breast Neoplasms
  • 46 Information and computing sciences
  • 40 Engineering