Skip to main content

Exploring Universal Singing Speech Language Identification Using Self-Supervised Learning Based Front-End Features

Publication ,  Conference
Wang, X; Wu, H; Ding, C; Huang, C; Li, M
Published in: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
January 1, 2023

Despite the great performance of language identification (LID), there is a lack of large-scale singing LID databases to support the research of singing language identification (SLID). This paper proposed a over 3200 hours dataset used for singing language identification, called Slingua. As the baseline, we explore two self-supervised learning (SSL) models, WavLM and Wav2vec2, as the feature extractors for both SLID and universal singing speech language identification (ULID), compared with the traditional handcraft feature. Moreover, by training with speech language corpus, we compare the performance difference of the universal singing speech language identification. The final results show that the SSL-based features exhibit more robust generalization, especially for low-resource and open-set scenarios. The database can be downloaded following this repository: https://github.com/Doctor-Do/Slingua.

Duke Scholars

Published In

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

DOI

ISSN

1520-6149

Publication Date

January 1, 2023

Volume

2023-June
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Wang, X., Wu, H., Ding, C., Huang, C., & Li, M. (2023). Exploring Universal Singing Speech Language Identification Using Self-Supervised Learning Based Front-End Features. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (Vol. 2023-June). https://doi.org/10.1109/ICASSP49357.2023.10095116
Wang, X., H. Wu, C. Ding, C. Huang, and M. Li. “Exploring Universal Singing Speech Language Identification Using Self-Supervised Learning Based Front-End Features.” In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, Vol. 2023-June, 2023. https://doi.org/10.1109/ICASSP49357.2023.10095116.
Wang X, Wu H, Ding C, Huang C, Li M. Exploring Universal Singing Speech Language Identification Using Self-Supervised Learning Based Front-End Features. In: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2023.
Wang, X., et al. “Exploring Universal Singing Speech Language Identification Using Self-Supervised Learning Based Front-End Features.” ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, vol. 2023-June, 2023. Scopus, doi:10.1109/ICASSP49357.2023.10095116.
Wang X, Wu H, Ding C, Huang C, Li M. Exploring Universal Singing Speech Language Identification Using Self-Supervised Learning Based Front-End Features. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2023.

Published In

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

DOI

ISSN

1520-6149

Publication Date

January 1, 2023

Volume

2023-June