Yes, you are right! The training speed of your calculating method is comparable with that I tried, but loss decreasing is much faster.
Speed now is just mind-blowing. 30 times faster that I had earlier. Thank you!!