Not necessarily - govt has already issued bonds on our existing debt, and future debt  we have options for how to source it.  

But even if so, there are ofsets.  E.g., CAD Dollar will rise against USD, which will actually LOWER some of our existing debt and make things like capital purchases (e.g., military equipment) cheaper.

A huge increase might have that effect, but a small increase might actually reduce our govt burden.