Hi,
I’m afraid it depends a lot on your task and you will have to try them to see how they perform in your particular case.
If your task is close to a classical one, it can be good to look at other models used there and try similar things first.