before bunnu could so much as utter a word of protest , this waifish , small-boned toady had already jumped ship and started swimming for the banks , to the annoyance of all , leaving them with no choice , but to moor the boat and see what was going on .