Yes, for me the difference in memory usages is even larger, ~90MB vs ~1390MB.
I guess the best we can do then, is compile libtorch ourselves with as few features enabled as possible.
Either way, I’m still quite surprised by the cuModuleGetFunction:s that do not succeed.
cheers!