@philschmid I found your example and many others after an hour or so of digging. Once you get the model into SageMaker, the inferrence instructions are pretty easy to google (you don’t even need to mention HuggingFace anymore since it’s abstracted from the SageMaker platform.
As you mentioned, I needed to set the Content-Type of the request to application/json and I also needed to correct my query string to this: {"inputs": "Hello World"}. That’s it, no need to plaster on the instances or data structures - if you’re only asking for one query you can just pass the request along as you normally would when using the HuggingFace inference API.
Thanks for the help! The way this integrates into AWS without too much hassle is super important and will encourage NLP adoption across many teams - no doubt.