The bandits far too busy trying to kill the rest of the defending party, not really wanting to get near you after those fireworks. So it stays at a standstill for the time being, with you standing there casting spells and the rest of the fight well under way. With you getting a nice view of the surrounding chaos and mayhem. You can see the captain on the higher deck, yelling obscenities and ordering his own sailors into the fight.