You are right, it is not constant but still shouldn’t there be a larger increase in  throughput if the batch size is x16 ?
I measured the time only for the forward pass through the network. So I think data loading should not be an issue.
I will try the latest release.