yes, as I test tensorflow timeline tools, except input image loader, almost all jobs are done by gpu.
I am not sure whether pytorch has similar policy with tensorflow. if similar policy seems no huge cpu memory usage, as I think if I just do one image inference(640x360), but when I print memory using gc it print >1G memory used. I am confused for that.
in additional, do you know how to control memory(reduce memory usage) during inference?