Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
cszhzleo
/
Mistral-7B-Instruct-v0.2-nc2-bs1-token1024-neuron-218
like
0
Text Generation
Transformers
mistral
Neuron
Optimum-Neuron
AWS
conversational
Inference Endpoints
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
cszhzleo
commited on
Apr 23, 2024
Commit
e761308
·
verified
·
1 Parent(s):
79eff00
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+5
-0
README.md
ADDED
Viewed
@@ -0,0 +1,5 @@
1
+
2
+
3
+
```
4
+
optimum-cli export neuron --model mistralai/Mistral-7B-Instruct-v0.2 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/mistralai/Mistral-7B-Instruct-v0.2
5
+
```