Hello Andrei,
If you still have it handy, could you share the boilerplate of the setup you’ve mentioned above?
I think the community can really benefit form this given that there aren’t any specific examples that popup when it comes to extending to PyTorch using dynamic parallelism.
You can also dm meat twitter  @KnockturnalNed