So even if the shape of the graph dramatically changes like changing the shape of arbitrary hidden layers, the derivatives are computed the same and the sudden change in dimensions doesn’t suddenly disrupt  convergence? Interesting.