Thank you @ecdrid for your valuable comment.
My model is based on CNN seq2seq and I need to use fasttext embedding with a small window. Honestly, I’m not sure about the optimal way to do that.
I have read the article you cited, I think is better to use fasttext embedding for words representation as a separate feature.
Kind regard,