Is there a way to visualize (the approximation of) the loss surface of my model as well as how parameters are updated over it in PyTorch?
Something like they did over here:

  
      
      deeplearning.ai
  
  
    

AI Notes: Parameter optimization in neural networks - deeplearning.ai 13

AI Notes: Parameter optimization in neural networks - deeplearning.ai