Optimum

Overview

Conceptual guides

Nvidia

AMD

Intel

AWS Trainium/Inferentia

Google TPUs

for Intel Gaudi

Furiosa

ONNX Runtime

Exporters

BetterTransformer

Torch FX

How-to guides

Conceptual guides

Reference

LLM quantization

Utilities

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Symbolic tracer

In Torch FX, the symbolic tracer feeds dummy values through the code to record the underlying operations.