Hi,
Thanks for the details.
I think these layers are relatively small and will run very quickly especially because the input/output size are fairly small.
But Adam has to handle all the 6.8M parameters so it’s not surprising to me to see it being so high in runtime.
This is unusual for neural nets because things like convolution or recurrent structure make the forward computation much more expensive compared to the number of parameters.