Hi All,
Is is possible to trace the GPT/Bert models on CPU and use that saved traced model on GPU?
I see a constant called “device” in the traced graph which seems persists in the saved models. This causes the model to be usable only on device where its traced, ie., if its traced on GPU devices then the saved JIT model is only usable on GPU hosts.  I am using PyTorch 1.4 and transformers 0.3.2
Am I missing something here?
Thanks,