fbaldassarri
/

meta-llama_Llama-3.2-1B-Instruct-TEQ-int4-gs128-asym

Text Generation

intel-neural-compressor

neural-compressor

Model card Files Files and versions Community

meta-llama_Llama-3.2-1B-Instruct-TEQ-int4-gs128-asym

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

fbaldassarri's picture

Initial Upload

118bac7 verified 3 months ago

.gitattributes

1.52 kB

initial commit 3 months ago
LICENSE.md

7.67 kB

Initial Upload 3 months ago
README.md

2.15 kB

Initial Upload 3 months ago
meta-llama_Llama-3.2-1B-Instruct-TEQ-int4-gs128-asym.py

13.5 kB

Initial Upload 3 months ago
qconfig.json

73.5 kB

Initial Upload 3 months ago
quantized_weight.pt
Detected Pickle imports (5)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.IntStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.7 GB
LFS

Initial Upload 3 months ago
requirements_conda_neural-compressor-3.3.1.txt

3.98 kB

Initial Upload 3 months ago