Solved by halfjoe in post #4 
              
              
                It turns out the gradients are not totally zeros. It’s just updating in a very very low speed. This is a stupid question and I will delete it soon. Thanks and sorry for your time!