Hi.
I am running a NAS (neural network search). The capacity of these models are too large even with batch_size =1 accounting for 18GB memory for a single GPU.
I have 4GPUs with with 12GB memory (48 GB totaly), how to run these code?