Hi,
Unfortunately, this is very hard to predict upfront.
If you want to have an exact value, to know the max memory consumption (including autograd buffers), the best way is to send your model to the gpu and do a forward backward.