Thanks!
What’s diffenrence between this solution and multiprocessing.Pool?
Do you mean that I should load a single model in each process and use the producer-consumer pattern like queues to input/output?