Hi Ardian!



 Ardian_Umam:

I got different accuracy results in both machine.


Could this be TF32?  Note that your 3090 gpu has TF32, while your
2080 gpu does not, so this is probably the issue.
(@ptrblck – Could you guys consider turning off TF32 by default?  TF32
is a nice feature, but recent evidence suggests that enabling it by default
counts as a bug.)
Please see this recent post:

  
    
    
    Considerable absolute error in torch.matmul 
  
  
    Hi Koramajin! 

Could this be the TF32 “bug?” 
What specific gpu are you using and does the issue go away if you set 
torch.backends.cuda.matmul.allow_tf32 = True? 
Edit: 
The above should read 
torch.backends.cuda.matmul.allow_tf32 = False

True is the default for allow_tf32.  The suggestion is to turn off TF32 
which is done by setting allow_tf32 to False. 
Best. 
K. Frank
  


Best.
K. Frank