```
Using a traced model for inference
Using the traced model for inference is as simple as using its __call__ dunder method:
python
traced_model(tokens_tensor, segments_tensors)
Deploying HuggingFace TorchScript models on AWS using the Neuron SDK
AWS introduced the Amazon EC2 Inf1 
instance family for low cost, high performance machine learning inference in the cloud. 
The Inf1 instances are powered by the AWS Inferentia chip, a custom-built hardware accelerator, 
specializing in deep learning inferencing workloads. 
AWS Neuron 
is the SDK for Inferentia that supports tracing and optimizing transformers models for 
deployment on Inf1. The Neuron SDK provides:
Easy-to-use API with one line of code change to trace and optimize a TorchScript model for inference in the cloud.
Out of the box performance optimizations for improved cost-performance
