Are you passing this flag as a single bool value for the whole batch or does each sample hold this attribute?
I skimmed through the tutorial and it seems iscrowd is part of the target dictionary with shape [N,].