Skip to main content
construction release_alert
The Scholars Team is working with OIT to resolve some issues with the Scholars search index
cancel

Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy

Publication ,  Conference
Pernice, WM; Doron, M; Quach, A; Pratapa, A; Kenjeyev, S; De Veaux, N; Hirano, M; Caicedo, JC
Published in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
January 1, 2023

Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal replicate structure of two novel single-cell fluorescent microscopy datasets, we propose generally applicable tests to assess the extent to which models learn causal representations across increasingly challenging levels of OOD-generalization. We show that despite seemingly strong performance as assessed by other established metrics, both naive and contemporary baselines designed to ward against confounding, collapse to random on these tests. We introduce a new method, Interventional Style Transfer (IST), that substantially improves OOD generalization by generating interventional training distributions in which spurious correlations between biological causes and nuisances are mitigated. We publish our code 1 and datasets 2.

Duke Scholars

Published In

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

DOI

EISSN

2160-7516

ISSN

2160-7508

Publication Date

January 1, 2023

Volume

2023-June

Start / End Page

4326 / 4335
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Pernice, W. M., Doron, M., Quach, A., Pratapa, A., Kenjeyev, S., De Veaux, N., … Caicedo, J. C. (2023). Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (Vol. 2023-June, pp. 4326–4335). https://doi.org/10.1109/CVPRW59228.2023.00455
Pernice, W. M., M. Doron, A. Quach, A. Pratapa, S. Kenjeyev, N. De Veaux, M. Hirano, and J. C. Caicedo. “Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy.” In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2023-June:4326–35, 2023. https://doi.org/10.1109/CVPRW59228.2023.00455.
Pernice WM, Doron M, Quach A, Pratapa A, Kenjeyev S, De Veaux N, et al. Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 2023. p. 4326–35.
Pernice, W. M., et al. “Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy.” IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 2023-June, 2023, pp. 4326–35. Scopus, doi:10.1109/CVPRW59228.2023.00455.
Pernice WM, Doron M, Quach A, Pratapa A, Kenjeyev S, De Veaux N, Hirano M, Caicedo JC. Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 2023. p. 4326–4335.

Published In

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

DOI

EISSN

2160-7516

ISSN

2160-7508

Publication Date

January 1, 2023

Volume

2023-June

Start / End Page

4326 / 4335