pytorch
/

gemma-3-12b-it-FP8

text-generation-inference

Model card Files Files and versions

gemma-3-12b-it-FP8

13.3 GB

1 contributor

History: 7 commits

jerryzh168's picture

Upload README.md with huggingface_hub

af2befe verified 3 months ago

.gitattributes

1.57 kB

Upload tokenizer 3 months ago
README.md

12.1 kB

Upload README.md with huggingface_hub 3 months ago
added_tokens.json

35 Bytes

Upload tokenizer 3 months ago
chat_template.jinja

1.53 kB

Upload tokenizer 3 months ago
config.json

4.22 kB

Upload Gemma3ForConditionalGeneration 3 months ago
generation_config.json

210 Bytes

Upload Gemma3ForConditionalGeneration 3 months ago
pytorch_model-00001-of-00003.bin

4.96 GB
xet

Upload Gemma3ForConditionalGeneration 3 months ago
pytorch_model-00002-of-00003.bin
Detected Pickle imports (17)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v3",
- "torchao.quantization.granularity.PerRow",
- "torchao.quantization.Float8Tensor",
- "torch.bfloat16",
- "torchao.float8.inference.Float8MMConfig",
- "torch._tensor._rebuild_from_type_v2",
- "torch.device",
- "torch.serialization._get_layout",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torchao.quantization.quantize_.workflows.float8.float8_tensor.QuantizeTensorToFloat8Kwargs",
- "torch.BFloat16Storage",
- "torchao.quantization.quantize_.common.kernel_preference.KernelPreference",
- "torch.float8_e4m3fn",
- "torch.storage.UntypedStorage",
- "torch._utils._rebuild_wrapper_subclass"
How to fix it?
4.99 GB
xet

Upload Gemma3ForConditionalGeneration 3 months ago
pytorch_model-00003-of-00003.bin
Detected Pickle imports (17)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v3",
- "torchao.quantization.granularity.PerRow",
- "torchao.quantization.Float8Tensor",
- "torch.bfloat16",
- "torchao.float8.inference.Float8MMConfig",
- "torch._tensor._rebuild_from_type_v2",
- "torch.device",
- "torch.serialization._get_layout",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torchao.quantization.quantize_.workflows.float8.float8_tensor.QuantizeTensorToFloat8Kwargs",
- "torch.BFloat16Storage",
- "torchao.quantization.quantize_.common.kernel_preference.KernelPreference",
- "torch.float8_e4m3fn",
- "torch.storage.UntypedStorage",
- "torch._utils._rebuild_wrapper_subclass"
How to fix it?
3.26 GB
xet

Upload Gemma3ForConditionalGeneration 3 months ago
pytorch_model.bin.index.json

109 kB

Upload Gemma3ForConditionalGeneration 3 months ago
special_tokens_map.json

662 Bytes

Upload tokenizer 3 months ago
tokenizer.json

33.4 MB
xet

Upload tokenizer 3 months ago
tokenizer.model

4.69 MB
xet

Upload tokenizer 3 months ago
tokenizer_config.json

1.16 MB

Upload tokenizer 3 months ago