Solved by philschmid in post #4 
              
              
                I could reproduce the issue and also found the root cause of it. The issue that 
Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.

And there is currently no way to pass in the max_length to the inference tool…