Nimi-san has gone against the Shinsengumi. To avoid anymore problems they want to get rid of Serizawa.

there is no need to take a large group.
فلا حاجة لأخذ مجموعة كبيرة
non serve un gruppo numeroso.
não precisaremos de muitos homens.
большая группа нам ни к чему.