Hi guys,
in order to saving the inference time, I expect to use one gpu card to predict multi images concurrently,  could someone give me some suggestion？many thanks.
By the way, I have  tried to used more than one batch to predict, it will be ok. However, I want to use multiprocessing to predict multi images in parallel.
Kind regards