I am fine moving with three people. If we need some party role we coerce/kidnap someone work for us or recruit from the good, bad and the ugly someone cover key role (like trapfinder but for that purpose intimidated peasants work just fine for finding traps).