Hi Philipp! @philschmid
I read the documentation twice and concluded, that I need to get deeper understanding of how the transformers work. The best way I found (as of know) - is to go through the HF Course 1 .
Even though I did many training jobs on Sagemaker with vanilla Pytorch, I feel like I need to

get a deeper understanding of “pipelines”, “tokenisers” and “post-processing”.
In my project I will also need to fine-tune a pre-trained model (because I am builing a product for not a widely-spoken language - slovenian).
The link you shared leads to “Advanced features” of the HF-Sagemeker" documentation (read twice).

Considering the three points above, I am timeboxing a week to go through the HF course to see if it will me to approach overriding default methods of HF inference toolkit.
Not sure if there is a better way to approach the problem of making sentence-similarity endpoint on sagemaker. My candidate was to train bag-of-words + cosine similarity from scratch in Pytorch (and then deploy the endpoint), but I feel I will be able to benefit from learning the transformers’ basics.
Thank you for helping me to find the direction for the solution!