Currently, I have to pass a device parameter into my custom layer and then manually put tensors onto the specified device manually using .to(device) or device=device.
Is this behavior expected? It looks kind of ugly to me.
Shouldn’t model.to(device) put all the layers, including my custom layer, to device for me?