Skip to main content

ScaleNAS: Multi-Path One-Shot NAS for Scale-Aware High-Resolution Representation

Publication ,  Conference
Cheng, HP; Liang, F; Li, M; Cheng, B; Yan, F; Li, H; Chandra, V; Chen, Y
Published in: Proceedings of Machine Learning Research
January 1, 2022

Scale variance among different sizes of body parts and objects is a challenging problem for visual recognition tasks. Existing works usually design a dedicated backbone or apply Neural architecture Search (NAS) for each task to tackle this challenge. However, existing works impose significant limitations on the design or search space. To solve these problems, we present ScaleNAS, a one-shot learning method for exploring scale-aware representations. ScaleNAS solves the limitation of scale representation by searching multi-scale feature aggregation. ScaleNAS adopts a flexible multi-path search space that allows an arbitrary number of blocks and cross-scale feature fusions. To cope with the high search cost incurred by the flexible space, ScaleNAS employs one-shot learning for multi-scale (multi-path) supernet driven by grouped sampling and evolutionary search. Without further retraining, ScaleNet can be directly deployed for different visual recognition tasks with superior performance. We use ScaleNAS to create high-resolution models for two different tasks, ScaleNet-P for human pose estimation and ScaleNet-S for semantic segmentation. ScaleNet-P and ScaleNet-S outperform existing manually crafted and NAS-based methods in both tasks. Using ScaleNet-P for bottom-up human pose estimation, it achieves a new state-of-the-art on COCO test-dev and CrowdPose test. In particular, ScaleNet-P4 achieves 71.3% AP on CrowdPose test, surpassing the previous best result by a large 3.7% AP margin.

Duke Scholars

Published In

Proceedings of Machine Learning Research

EISSN

2640-3498

Publication Date

January 1, 2022

Volume

188
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Cheng, H. P., Liang, F., Li, M., Cheng, B., Yan, F., Li, H., … Chen, Y. (2022). ScaleNAS: Multi-Path One-Shot NAS for Scale-Aware High-Resolution Representation. In Proceedings of Machine Learning Research (Vol. 188).
Cheng, H. P., F. Liang, M. Li, B. Cheng, F. Yan, H. Li, V. Chandra, and Y. Chen. “ScaleNAS: Multi-Path One-Shot NAS for Scale-Aware High-Resolution Representation.” In Proceedings of Machine Learning Research, Vol. 188, 2022.
Cheng HP, Liang F, Li M, Cheng B, Yan F, Li H, et al. ScaleNAS: Multi-Path One-Shot NAS for Scale-Aware High-Resolution Representation. In: Proceedings of Machine Learning Research. 2022.
Cheng, H. P., et al. “ScaleNAS: Multi-Path One-Shot NAS for Scale-Aware High-Resolution Representation.” Proceedings of Machine Learning Research, vol. 188, 2022.
Cheng HP, Liang F, Li M, Cheng B, Yan F, Li H, Chandra V, Chen Y. ScaleNAS: Multi-Path One-Shot NAS for Scale-Aware High-Resolution Representation. Proceedings of Machine Learning Research. 2022.

Published In

Proceedings of Machine Learning Research

EISSN

2640-3498

Publication Date

January 1, 2022

Volume

188