This should be the case for some models, but the minimal size would need to be determined for each model separately. Feel free to create a GitHub issue and let us know, if you would be interested in fixing this.