The tutorials seem to be upgraded to the latest release. In fact tensor.require_grad_ was introduced in 0.4.0.
In the github repo you will find the tutorials in pytorch/tutorials.
There are several open issues 4. Have a look at those marked as simple fixes.