Skip to main content

MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints.

Publication ,  Journal Article
Huang, O; Long, W; Bottenus, N; Lerendegui, M; Trahey, GE; Farsiu, S; Palmeri, ML
Published in: IEEE transactions on medical imaging
June 2020

Image post-processing is used in clinical-grade ultrasound scanners to improve image quality (e.g., reduce speckle noise and enhance contrast). These post-processing techniques vary across manufacturers and are generally kept proprietary, which presents a challenge for researchers looking to match current clinical-grade workflows. We introduce a deep learning framework, MimickNet, that transforms conventional delay-and-summed (DAS) beams into the approximate Dynamic Tissue Contrast Enhanced (DTCE™) post-processed images found on Siemens clinical-grade scanners. Training MimickNet only requires post-processed image samples from a scanner of interest without the need for explicit pairing to DAS data. This flexibility allows MimickNet to hypothetically approximate any manufacturer's post-processing without access to the pre-processed data. MimickNet post-processing achieves a 0.940 ± 0.018 structural similarity index measurement (SSIM) compared to clinical-grade post-processing on a 400 cine-loop test set, 0.937 ± 0.025 SSIM on a prospectively acquired dataset, and 0.928 ± 0.003 SSIM on an out-of-distribution cardiac cine-loop after gain adjustment. To our knowledge, this is the first work to establish deep learning models that closely approximate ultrasound post-processing found in current medical practice. MimickNet serves as a clinical post-processing baseline for future works in ultrasound image formation to compare against. Additionally, it can be used as a pretrained model for fine-tuning towards different post-processing techniques. To this end, we have made the MimickNet software, phantom data, and permitted in vivo data open-source at https://github.com/ouwen/MimickNet.

Duke Scholars

Published In

IEEE transactions on medical imaging

DOI

EISSN

1558-254X

ISSN

0278-0062

Publication Date

June 2020

Volume

39

Issue

6

Start / End Page

2277 / 2286

Related Subject Headings

  • Ultrasonography
  • Phantoms, Imaging
  • Nuclear Medicine & Medical Imaging
  • Image Processing, Computer-Assisted
  • 46 Information and computing sciences
  • 40 Engineering
  • 09 Engineering
  • 08 Information and Computing Sciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Huang, O., Long, W., Bottenus, N., Lerendegui, M., Trahey, G. E., Farsiu, S., & Palmeri, M. L. (2020). MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints. IEEE Transactions on Medical Imaging, 39(6), 2277–2286. https://doi.org/10.1109/tmi.2020.2970867
Huang, Ouwen, Will Long, Nick Bottenus, Marcelo Lerendegui, Gregg E. Trahey, Sina Farsiu, and Mark L. Palmeri. “MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints.IEEE Transactions on Medical Imaging 39, no. 6 (June 2020): 2277–86. https://doi.org/10.1109/tmi.2020.2970867.
Huang O, Long W, Bottenus N, Lerendegui M, Trahey GE, Farsiu S, et al. MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints. IEEE transactions on medical imaging. 2020 Jun;39(6):2277–86.
Huang, Ouwen, et al. “MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints.IEEE Transactions on Medical Imaging, vol. 39, no. 6, June 2020, pp. 2277–86. Epmc, doi:10.1109/tmi.2020.2970867.
Huang O, Long W, Bottenus N, Lerendegui M, Trahey GE, Farsiu S, Palmeri ML. MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints. IEEE transactions on medical imaging. 2020 Jun;39(6):2277–2286.

Published In

IEEE transactions on medical imaging

DOI

EISSN

1558-254X

ISSN

0278-0062

Publication Date

June 2020

Volume

39

Issue

6

Start / End Page

2277 / 2286

Related Subject Headings

  • Ultrasonography
  • Phantoms, Imaging
  • Nuclear Medicine & Medical Imaging
  • Image Processing, Computer-Assisted
  • 46 Information and computing sciences
  • 40 Engineering
  • 09 Engineering
  • 08 Information and Computing Sciences