You could store the gradients in save_gradients in a list or dict and try to visualize them.
However, since the shapes will most likely differ, I assume you would like to visualize the gradients of each parameter separately?