aldeka12:

on, I only need GPU memory consumption of forward pass. Also, is there a way to know total size of the model (using special methods or by using number of parameters)?


You can monitor the status of your GPU via nvidia-smi.
E.g., you can create a simple script that only passes your model to GPU and then waits. Monitoring the GPU usage of such script may give you an idea.