@iffiX Thank you, I will try to reduce the buffer size at first. @a_d My implementation is actually based on the TorchBeast implementation
https://github.com/facebookresearch/torchbeast/blob/master/torchbeast/monobeast.py
, all I’ve modified is that I added some new models to train.