That’s interesting, as I haven’t seen such a small context in a while. Could you point me to an example, if possible?
E.g using the matrixMul example on an A100 I see a memory usage of ~400MB for a matmul of [1, 1] x [1, 1].
Building for sm_80 or all architectures also doesn’t change the usage.