RL unlike say vision or text is not easy to get API design right.
There are several competing RL packages for pytorch, but neither is generic enough to be a core package – this is why we removed the official RL package before release.