In the documentation (and many other places online) is stated that autograd is tape based:

image.png1380×206 20.2 KB

but in Paszke, Adam, et al. “Automatic differentiation in PyTorch.” (2017) is clearly stated:

image.png1036×272 67.8 KB

So I guess it’s not?