Hello @pavel-nesterov,
Currently, the SageMaker Inference Toolkit only supports the NLP-based pipelines from the transformers library for zero-code deployments.
But you can easily create your own inference.py which contains the code you would need for that.
Here is Documentation on that: Deploy models to Amazon SageMaker 14
Here the code for the sentence-simliarity pipeline: huggingface_hub/sentence_similarity.py at main · huggingface/huggingface_hub · GitHub 20
Thank you for the request I will add it as potential feature to the roadmap.