Hi,
The main reason for “we construct our models without knowing the batch size” is because usually, the model should handle each element in the batch as if they were independent.
Here you actually want your model to behave differently for different elements in the batch, so this does not apply anymore and you’ll need to know the batch size beforehand.