Thanks!
I actually made a mistake in the original post, what I changed the code to is
... create_graph=False, retain_graph=True,...
or
... create_graph=False, retain_graph=None,...
the code still works, but the model generates same image (model collapse?)