Solved by cpuhrsch in post #2 
              
              
                Hello Philip, 
If you’re interested in ongoing development we’re currently working on https://github.com/pytorch/nestedtensor as a first-class representation of collections of variably sized Tensors. I’m happy to talk further about this if you want and would love your feedback. 
Thanks, 
Christian