mathematicsofpaul:

What did you end up changing


I still use the same model and after some time it starts to produce better predictions. But it takes more time then I was expecting and the final result is worse than other implementations.
My implementation 6.
Good, working implementation 6. It converges much faster and final loss N times better.
Can you please suggest what can be wrong with my code, how should I debug the issue?
@mathematicsofpaul