That woud appear to be my impl. Unexpected error, especially given that the default remained to not flatten when that was added. A lot of GPU usage with that change in and no problems noticed.
@Bauke_Brenninkmeijer I just ran on a clean environement, PyTorch 1.5.0 cpu (conda) and no such issue. Any chance you’ve got multiple PyTorch or timm versions in the environment/path? It wasn’t long ago that flatten didn’t exist in PyTorch.