I somewhat still get data corruption, doing just the forward pass and calling as_strided_ when sizes are equal.
If I replace copy_() with to(), its totally OK.
I wonder if its related to cuda streams or something?
a.copy_(b) when a,b are on different devices?