Thank you! i ll fix it there.
For inference, the Hugging Face Inference Toolkit 1 is used, which is easily speaking a sagemaker compatible wrapper around the pipelines object with an API structure similar to the Inference API. You can find more documentation here: Reference