Skip to main content

Call for Help Detection in Emergent Situations Using Keyword Spotting and Paralinguistic Analysis

Publication ,  Conference
Chu, H; Wang, Y; Ju, R; Jia, Y; Wang, H; Li, M; Deng, Q
Published in: ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction
October 18, 2021

Nowadays, the safety of passengers within the enclosed public space, such as the elevator, becomes more and more important. Though the passengers can click the "SOS"button to call the remote safety guard, the chances are that some passengers might lose their ability to stand up to click the button or it is not convenient to do so when in emergency situations. Also, people's first reaction may be to call for help using voice instead of pressing the mayday button. Thus, we believe a speech-based system is very useful under this scenario. This work proposes a system using keyword spotting and paralinguistic analysis to detect whether the passenger calls for help in mandarin and gives real-time feedback which might provide the passenger within time help to prevent the accident. Unlike the standard keyword spotting task which is to detect the pre-defined call for help keyword "jiu ming"in any scenario, we focus on detecting both the keyword and the paralinguistic states. The system will only be triggered when the keyword and the emergency situation such as shouting or screaming appear at the same time. To this end, we compare the performance of different methods and we find that the deep neural network-based small-footprint keyword spotting methods are effective and efficient for keyword spotting tasks under emotional scenarios.

Duke Scholars

Published In

ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction

DOI

Publication Date

October 18, 2021

Start / End Page

104 / 111
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Chu, H., Wang, Y., Ju, R., Jia, Y., Wang, H., Li, M., & Deng, Q. (2021). Call for Help Detection in Emergent Situations Using Keyword Spotting and Paralinguistic Analysis. In ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction (pp. 104–111). https://doi.org/10.1145/3461615.3491111
Chu, H., Y. Wang, R. Ju, Y. Jia, H. Wang, M. Li, and Q. Deng. “Call for Help Detection in Emergent Situations Using Keyword Spotting and Paralinguistic Analysis.” In ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction, 104–11, 2021. https://doi.org/10.1145/3461615.3491111.
Chu H, Wang Y, Ju R, Jia Y, Wang H, Li M, et al. Call for Help Detection in Emergent Situations Using Keyword Spotting and Paralinguistic Analysis. In: ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction. 2021. p. 104–11.
Chu, H., et al. “Call for Help Detection in Emergent Situations Using Keyword Spotting and Paralinguistic Analysis.” ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction, 2021, pp. 104–11. Scopus, doi:10.1145/3461615.3491111.
Chu H, Wang Y, Ju R, Jia Y, Wang H, Li M, Deng Q. Call for Help Detection in Emergent Situations Using Keyword Spotting and Paralinguistic Analysis. ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction. 2021. p. 104–111.

Published In

ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction

DOI

Publication Date

October 18, 2021

Start / End Page

104 / 111