I’m not sure what the limit is.
If you change features in my example code to a 10dimensional tensor (features = torch.randn(nb_samples, 2, 2, 2, 2, 2, 2, 2, 2, 10)), it still works on the CPU and GPU.
I think I’ve heard once some limitation regarding the dimensionality of GPU tensors, but I can’t produce an example which is not working currently.
Who told you 3dimensional tensors are now allowed?