I’m not sure how your estimator works, but you could probably just port the code to PyTorch.
A lot of numpy operations are implemented in PyTorch, so that you could change the namespace and run the PyTorch operation.
If you encounter some methods which are missing, let us know as there might be some workarounds.