I got the cost time of each part:
dataloder of next batch:
about 20s

inference:
about 0.7s

copy tensor to cpu and get results:
about 0.0001s

I seems that dataloader cost too much time. How to improve it?