Hello, everyone.
In every source file implementing attentions and transformers,
I’ve found there is no backward function inside the class of Transformer
I wonder why there is no backward method in the class of Transformer ?
Also, how to backpropagate the Transformer?
In pytorch, will pytorch engine backpropagate the encoder and the decode together up thru all layers?
I wonder, as I mentioned, how this works without implementing backward in Transformer class.
Thank you in advance