Thanks for your response. I def checked that thread, but their implementation is not quite clear and it yields to errors in the newer versions of Pytorch. Ignite engine has an implementation for TBPTT but only for very fixed scenarios (i.e., supervised trainer and k1= k2).