File size: 280 Bytes
9a70f91 |
1 2 3 4 5 6 7 8 |
---
license: apache-2.0
---
Compiled CodeLlama-7b-Instruct-hf using optimum-neuron
```
optimum-cli export neuron --model codellama/CodeLlama-7b-Instruct-hf --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/codellama/CodeLlama-7b-Instruct-hf
``` |