Hi,
I’m afraid this is the cuda driver memory use.
As you can see in your first example: putting (almost) nothing on the GPU does the same.
There is no way to clear that driver’s memory I’m afraid unless you stop your process