If you set num_workers=1 multiprocessing will still be used. Could you try to run your code with num_workers=0 and check if it works.
While this is not a solution, it might indeed point to an issue regarding multiprocessing.
Also, which OS are you using? If Windows, I assume you are using the if-clause protection.