@ptrblck Hi than you for your reply!
image770×140 11.9 KB
I realized that my momentum value is set in really low value currently, but apparently it is recommended to set high value when I am training in small batch.
Using the equation above, could you please interpret to me how the statement is valid?