Neuro2Semantic: A Transfer Learning Framework for Semantic
  Reconstruction of Continuous Language from Human Intracranial EEG
Decoding continuous language from neural signals remains a significant
challenge in the intersection of neuroscience and artificial intelligence. We
introduce Neuro2Semantic, a novel framework that reconstructs the semantic
content of perceived speech from intracranial EEG (iEEG) recordings. Our
approach consists of two phases: first, an LSTM-based adapter aligns neural
signals with pre-trained text embeddings; second, a corrector module generates
continuous, natural text directly from these aligned embeddings. This flexible
method overcomes the limitations of previous decoding approaches and enables
unconstrained text generation. Neuro2Semantic achieves strong performance with
as little as 30 minutes of neural data, outperforming a recent state-of-the-art
method in low-data settings. These results highlight the potential for
practical applications in brain-computer interfaces and neural decoding
technologies.
683f147e791f5015dfcb644a
Siavash Shams
claimed_verified
2025-06-04T09:01:49.892Z
6637d9685eedec13fcbd1f87
/avatars/a72d4e289c28b4d91757241d7b25985d.svg
Siavash
user
attentionisallyouneed369
683f147e791f5015dfcb644b
Richard Antonello
683f147e791f5015dfcb644c
Gavin Mischler
683f147e791f5015dfcb644d
Stephan Bickel
683f147e791f5015dfcb644e
Ashesh Mehta
683f147e791f5015dfcb644f
Nima Mesgarani
Neuro2Semantic: A Transfer Learning Framework for Semantic
  Reconstruction of Continuous Language from Human Intracranial EEG
Decoding continuous language from neural signals remains a significant
challenge in the intersection of neuroscience and artificial intelligence. We
introduce Neuro2Semantic, a novel framework that reconstructs the semantic
content of perceived speech from intracranial EEG (iEEG) recordings. Our
approach consists of two phases: first, an LSTM-based adapter aligns neural
signals with pre-trained text embeddings; second, a corrector module generates
continuous, natural text directly from these aligned embeddings. This flexible
method overcomes the limitations of previous decoding approaches and enables
unconstrained text generation. Neuro2Semantic achieves strong performance with
as little as 30 minutes of neural data, outperforming a recent state-of-the-art
method in low-data settings. These results highlight the potential for
practical applications in brain-computer interfaces and neural decoding
technologies.
Neuro2Semantic reconstructs semantic content from neural signals using LSTM-based alignment and text generation, outperforming existing methods with limited data.
iEEG LSTM align text embeddings corrector module neural decoding brain-computer interfaces