It depends on the available memory of your GPU.
If you have a newer GPU with 16 or 32GB, some operations might be possible on this tensor.
Depending on the operation, you might need to create an output tensor, which could take the same amount of memory.
Which operations are you interested in?