This blog post 8 says that we can make transformer much faster while decoding by caching the previous inputs, since there’s no need to re-compute all the same things we already computed. When I read the implementation of the torch.nn.Transformer code, it doesn’t seem to have such feature (at least for 1.7.0). If I’m right, is there any plan to implement such feature, or is it already implemented by someone and will be released in 1.8.0? Thanks!