Speech emotion recognition based on Graph-LSTM neural network

Research output: Contribution to journalArticlepeer-review

Abstract

Currently, Graph Neural Networks have been extended to the field of speech signal processing. It is the more compact and flexible way to represent speech sequences by graphs. However, the structures of the relationships in recent studies are tend to be relatively uncomplicated. Moreover, the graph convolution module exhibits limitations that impede its adaptability to intricate application scenarios. In this study, we establish the speech-graph using feature similarity and introduce a novel architecture for graph neural network that leverages an LSTM aggregator and weighted pooling. The unweighted accuracy of 65.39% and the weighted accuracy of 71.83% are obtained on the IEMOCAP dataset, achieving the performance comparable to or better than existing graph baselines. This method can improve the interpretability of the model to some extent, and identify speech emotion features effectively.

Original languageEnglish
Article number40
JournalEurasip Journal on Audio, Speech, and Music Processing
Volume2023
Issue number1
DOIs
Publication statusPublished - Dec 2023

Keywords

  • Graph neural networks
  • Long short-term memory
  • Speech emotion recognition

Fingerprint

Dive into the research topics of 'Speech emotion recognition based on Graph-LSTM neural network'. Together they form a unique fingerprint.

Cite this