Well I assumed there will be performance loss, but wasn’t expecting this much. I mean same disadvantages of smaller array will plague numpy as well. Is there any benchmarks or treatment of comparison of numpy vs pytorch with array size?
I am in the process of porting it to TF and Julia/Flux for comparison. If it is due to small tensor size, then similar loss of performance might get observed in TF as well?