Thanks for your reply…
I’m  loading 4 (“only four…”) BERT models… yes the four models are really large… I’m working on Emotive Computing.
I’m not training ,… I’ve trained on collab and now I’m only loading the models for predicting (for now) on my local machine, …
the last process is a flask web service that loads the models and make predictions.
As I’m newby eith CUDA on a local machine,…
The first question is:

I’m doing it correctly or I’m making some mistakes? Can I move python and the WS to the CPU memory (I think it is not possible…)?

Thanks in advance
Jeronimo