This depends on you talking about national debt or private debt. For national debt, the dynamic you describe holds true. But for private (households, companies) debt it does not as they do not have the capacity to create new money.