I tried to verify some equations with torch and pytorch, and accidentally found that the gradients differs.

  
      github.com/torch/nn
  
  
    
  
	  
  

  
    
      [Linear Layer] Possibly wrong gradient? 11
    

    
      
        opened 
        
          
        
        Jul 28, 2017
      
      

        
          closed 
        
          
        
        Jul 29, 2017
      
        

      
        
          
          cdluminate
        
      
    
  



  I thought the formulations for the Linear layer should be:
column y, Matrix M, column x, column b
y = Wx + b
δ...