Hi @Bohaterowicz, here is some of my understanding:

Forking will not happen automatically. You need to manually insert fork and wait just as the document mentions.
Libtorch already fork the inference threads based on num_interop_threads. But you need to invoke this thread manually(push your function into the task queue).