Thanks for the follow-up. I’m still unable to understand why the batch size changes, if you are passing a single input. In “standard” use cases the batch size would be equal for the input shape and would not change, i.e. it indicates how many samples are processed in the current batch by the model.
E.g. if you are passing 5 samples to the model, you would expect to get 5 “results”.
Your current use case would reduce or increase the number of samples, so is this expected?