Solved by ptrblck in post #4 
              
              
                Thanks for the update and I clearly misunderstood the use case. 
I think if the kernel shapes are different, you would need to use a loop and concatenate the output afterwards, as the filters cannot be stored directly in a single tensor. 
However, if the kernels have all the same shape, the grouped …