eXCube2: Explainable Brain-Inspired Spiking Neural Network Framework for Emotion Recognition from Audio, Visual and Multimodal Audio-Visual Data

This paper introduces a biomimetic framework and novel brain-inspired AI (BIAI) models based on spiking neural networks (SNNs) for emotional state recognition from audio (speech), visual (face), and integrated multimodal audio-visual data. The developed framework, named eXCube2, uses a three-dimensional SNN architecture NeuCube that is spatially structured according to a human brain template. The BIAI models developed in eXCube2 are trainable on spatio- and spectro-temporal data using…

via https://pubmed.ncbi.nlm.nih.gov/41892131/?utm_source=Other&utm_medium=rss&utm_campaign=None&utm_content=1L37KAMf2b_g4WEK3LmdFuKZu9pO3cN7u4ZmO9PPCPeBLMIw1q&fc=None&ff=20260403010907&v=2.19.0.post6+133c1fe