Sorry this isn’t much (it’s kinda late here), but this post 107 has a snippet that lets you examine the gradient flow, and @apaszke has a GitHub Gist 34 that should let you see the network’s graph.  Hope that helps!