So removing the graph network stuff doesn’t change the memory error. This colab is my attempt to reproduce it, but it runs without any memory incrase: https://colab.research.google.com/drive/1IiVFdB2hUttfgrpgwCnOXYmxKN1-43S0?usp=sharing 2