Road to 1.0 65 should answer nearly all your questions.
For the benchmarks you may look at this 21, this 16 or this 16 link. They usually are not comparing single ops but to get a general overview it is still usable, even if they don’t use the current stable release. @smth does not even compare with Pytorch but with torch which should be equally fast as huge parts of the backends are/were the same (not sure what has been changed by migration to ATen).