Hi, I am just trying apex for the first time and running into the following error when training camembert using fast-bert:
Found param roberta.embeddings.word_embeddings.weight with type torch.FloatTensor, expected torch.cuda.FloatTensor.
I also get this indication, but i still don’t know how to deal with it:
When using amp.initialize, you need to provide a model with parameters
located on a CUDA device before passing it no matter what optimization level
you chose. Use model.to(‘cuda’) to use the default device.
PS: I don’t have an Nvidia gpu so i didn’t install cuda