Skip to main content

SWSSL: Sliding Window-Based Self-Supervised Learning for Anomaly Detection in High-Resolution Images.

Publication ,  Journal Article
Dong, H; Zhang, Y; Gu, H; Konz, N; Zhang, Y; Mazurowski, MA
Published in: IEEE Trans Med Imaging
December 2023

Anomaly detection (AD) aims to determine if an instance has properties different from those seen in normal cases. The success of this technique depends on how well a neural network learns from normal instances. We observe that the learning difficulty scales exponentially with the input resolution, making it infeasible to apply AD to high-resolution images. Resizing them to a lower resolution is a compromising solution and does not align with clinical practice where the diagnosis could depend on image details. In this work, we propose to train the network and perform inference at the patch level, through the sliding window algorithm. This simple operation allows the network to receive high-resolution images but introduces additional training difficulties, including inconsistent image structure and higher variance. We address these concerns by setting the network's objective to learn augmentation-invariant features. We further study the augmentation function in the context of medical imaging. In particular, we observe that the resizing operation, a key augmentation in general computer vision literature, is detrimental to detection accuracy, and the inverting operation can be beneficial. We also propose a new module that encourages the network to learn from adjacent patches to boost detection performance. Extensive experiments are conducted on breast tomosynthesis and chest X-ray datasets and our method improves 8.03% and 5.66% AUC on image-level classification respectively over the current leading techniques. The experimental results demonstrate the effectiveness of our approach.

Duke Scholars

Published In

IEEE Trans Med Imaging

DOI

EISSN

1558-254X

Publication Date

December 2023

Volume

42

Issue

12

Start / End Page

3860 / 3870

Location

United States

Related Subject Headings

  • Supervised Machine Learning
  • Nuclear Medicine & Medical Imaging
  • Neural Networks, Computer
  • Algorithms
  • 46 Information and computing sciences
  • 40 Engineering
  • 09 Engineering
  • 08 Information and Computing Sciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Dong, H., Zhang, Y., Gu, H., Konz, N., & Mazurowski, M. A. (2023). SWSSL: Sliding Window-Based Self-Supervised Learning for Anomaly Detection in High-Resolution Images. IEEE Trans Med Imaging, 42(12), 3860–3870. https://doi.org/10.1109/TMI.2023.3314318
Dong, Haoyu, Yifan Zhang, Hanxue Gu, Nicholas Konz, Yixin Zhang, and Maciej A. Mazurowski. “SWSSL: Sliding Window-Based Self-Supervised Learning for Anomaly Detection in High-Resolution Images.IEEE Trans Med Imaging 42, no. 12 (December 2023): 3860–70. https://doi.org/10.1109/TMI.2023.3314318.
Dong H, Zhang Y, Gu H, Konz N, Mazurowski MA. SWSSL: Sliding Window-Based Self-Supervised Learning for Anomaly Detection in High-Resolution Images. IEEE Trans Med Imaging. 2023 Dec;42(12):3860–70.
Dong, Haoyu, et al. “SWSSL: Sliding Window-Based Self-Supervised Learning for Anomaly Detection in High-Resolution Images.IEEE Trans Med Imaging, vol. 42, no. 12, Dec. 2023, pp. 3860–70. Pubmed, doi:10.1109/TMI.2023.3314318.
Dong H, Zhang Y, Gu H, Konz N, Mazurowski MA. SWSSL: Sliding Window-Based Self-Supervised Learning for Anomaly Detection in High-Resolution Images. IEEE Trans Med Imaging. 2023 Dec;42(12):3860–3870.

Published In

IEEE Trans Med Imaging

DOI

EISSN

1558-254X

Publication Date

December 2023

Volume

42

Issue

12

Start / End Page

3860 / 3870

Location

United States

Related Subject Headings

  • Supervised Machine Learning
  • Nuclear Medicine & Medical Imaging
  • Neural Networks, Computer
  • Algorithms
  • 46 Information and computing sciences
  • 40 Engineering
  • 09 Engineering
  • 08 Information and Computing Sciences