Skip to main content

A causal deep learning framework for classifying phonemes in cochlear implants

Publication ,  Conference
Chu, K; Collins, L; Mainsah, B
Published in: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
January 1, 2021

Speech intelligibility in cochlear implant (CI) users degrades considerably in listening environments with reverberation and noise. Previous research in automatic speech recognition (ASR) has shown that phoneme-based speech enhancement algorithms improve ASR system performance in reverberant environments as compared to a global model. However, phoneme-specific speech processing has not yet been implemented in CIs. In this paper, we propose a causal deep learning framework for classifying phonemes using features extracted at the time-frequency resolution of a CI processor. We trained and tested long short-term memory networks to classify phonemes and manner of articulation in anechoic and reverberant conditions. The results showed that CI-inspired features provide slightly higher levels of performance than traditional ASR features. To the best of our knowledge, this study is the first to provide a classification framework with the potential to categorize phonetic units in real-time in a CI.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

DOI

ISSN

1520-6149

Publication Date

January 1, 2021

Volume

2021-June

Start / End Page

6498 / 6502
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Chu, K., Collins, L., & Mainsah, B. (2021). A causal deep learning framework for classifying phonemes in cochlear implants. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (Vol. 2021-June, pp. 6498–6502). https://doi.org/10.1109/ICASSP39728.2021.9413986
Chu, K., L. Collins, and B. Mainsah. “A causal deep learning framework for classifying phonemes in cochlear implants.” In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2021-June:6498–6502, 2021. https://doi.org/10.1109/ICASSP39728.2021.9413986.
Chu K, Collins L, Mainsah B. A causal deep learning framework for classifying phonemes in cochlear implants. In: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2021. p. 6498–502.
Chu, K., et al. “A causal deep learning framework for classifying phonemes in cochlear implants.” ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, vol. 2021-June, 2021, pp. 6498–502. Scopus, doi:10.1109/ICASSP39728.2021.9413986.
Chu K, Collins L, Mainsah B. A causal deep learning framework for classifying phonemes in cochlear implants. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2021. p. 6498–6502.

Published In

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

DOI

ISSN

1520-6149

Publication Date

January 1, 2021

Volume

2021-June

Start / End Page

6498 / 6502