Solved by ptrblck in post #5 
              
              
                You are right. I only see the smaller ~3MB allocation, but not the creation of the CUDA context. 
In that case you might need to create a dummy tensor instead in the init method.