@levivana Thanks a lot for a detailed test. Results are interesting!
I’m not worrying that it will return a bad result if I don’t pass a non-contiguous tensor, I was basically wondering whether it makes sense to cache a materialized scalar bias tensor if I’m calling this kind of op many times (if the underlying conv call converts bias to contiguous, it makes sense to cache it to bypass the copying call).