Hi, I have model A (a Flownet based model) and model B (a PWC-Net based model). The inference time of model B is lower than model A on GPU, but on CPU the relation is reversed. I would expect that a model which is faster on GPU would also be faster on CPU, but this doesn’t seem to be the case. Can someone please let me know if this is normal and if there are any workarounds to mitigate the issue?
Thanks.