Thank you for your answer!
I expected some overhead, but this was a bit more than I though.


These indexing ops do not get as much love in PyTorch as core NN code (like linear/conv) and so we might be able to optimize them. If you find one in particular that is especially lacking, you can open an issue and we should be able to improve that.


Just to confirm: I will check individual operations and then open issues for them?