Dear @jpeg729,
Thank you so much for your suggestion. I think that your ideas of grouping hidden representations and using 1D convolution are pretty brilliant!!! And I will have a try accordingly.
Regards,
Zengjie Song