iproskurina
/

opt-1.3b-GPTQ-4bit-g128

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions Community

opt-1.3b-GPTQ-4bit-g128

Ctrl+K

Ctrl+K

1 contributor

History: 19 commits

iproskurina's picture

Update README.md to include GPTQModel usage.

f9c98f5 verified 4 months ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

2.75 kB

Update README.md to include GPTQModel usage. 4 months ago
config.json

749 Bytes

AutoGPTQ model for facebook/opt-1.3b: 4bits, gr128, desc_act=False 10 months ago
merges.txt

456 kB

Add tokenizer for the model opt-1.3b 10 months ago
model.safetensors

1.05 GB
LFS

Rename gptq_model-4bit-128g.safetensors to model.safetensors 10 months ago
quantize_config.json

211 Bytes

AutoGPTQ model for facebook/opt-1.3b: 4bits, gr128, desc_act=False 10 months ago
special_tokens_map.json

548 Bytes

Add tokenizer for the model opt-1.3b 10 months ago
tokenizer.json

2.11 MB

Add tokenizer for the model opt-1.3b 10 months ago
tokenizer_config.json

669 Bytes

Add tokenizer for the model opt-1.3b 10 months ago
vocab.json

798 kB

Add tokenizer for the model opt-1.3b 10 months ago