Hello, I have a question about the warmup part of the code that was posted.
Why is there two warmup calls to forward? I have found that I sometimes need this as well. I was wondering if this is just a heuristic or if somebody could point me towards documentation or concrete reasons why this is a good idea.
Thanks!