Matrix, Dimensions.
dimensional. Hopefully, these two equations help you to double-check that the dimensions of your matrices, w, as well as of your vectors b are the correct dimensions. Of course, if you’re implementing back-propagation, then the dimensions of dw should be the same as dimension of w. So dw should be