@ahkarami @ptrblck  Failed to use this code to inference multiple models on single GPU on windows.
RuntimeError: cuda runtime error (71) : operation not supported at C:\w\1\s\windows\pytorch\torch/csrc/generic/StorageSharing.cpp:245
Could you pls help me to solve this problem?