Hey @Diego,
the Timer was just to demonstrate that it really takes this long -> but i agree with you there is alot of overhead, i’ll edit the post. I work a lot with RNNs and as you might know you’ll init your hidden (and cell) state with for instance with torch.zero tensors. After the update to 0.4 my code got extremely slow. I profiled my code and it turned out that torch.zeros was the problem…
Everytime I initialized my hidden with,
torch.zeros(3, 80, 1),
it took 0.5 seconds. What a disaster.
Best regards,
Magnus