Thanks for putting together this great toolkit. I had a question of how inference batching is handled. I noticed that the examples here 1 all appear to have a single input request. Once deployed, if multiple requests are made to the endpoint of a deployed model at once or in quick succession, are they automatically batched under the hood, or is there something you need to do before hitting the endpoint to feed in a batch of inputs manually?