Create torch_compile_example
#3
by
ydshieh
HF staff
- opened
This is a (more detailed) python script that shows the usage of torch.compile
with generate
with comments regarding:
- compilation time
- how
max_lengh
is related to the static cache object - changing length and recompilation
- cache object being (due to longer length specified) recreated and recompilation
osanseviero
changed pull request status to
closed