RedHatAI
/

Phi-3-medium-128k-instruct-quantized.w8a8

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

Phi-3-medium-128k-instruct-quantized.w8a8

Ctrl+K

Ctrl+K

2 contributors

History: 10 commits

mgoin's picture

Updated compression_config to quantization_config

4b7e106 verified 10 months ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

7.33 kB

Update README.md 11 months ago
added_tokens.json

293 Bytes

Upload folder using huggingface_hub about 1 year ago
config.json

4.33 kB

Updated compression_config to quantization_config 10 months ago
configuration_phi3.py

10.4 kB

Upload folder using huggingface_hub about 1 year ago
generation_config.json

172 Bytes

Upload folder using huggingface_hub 11 months ago
model-00001-of-00003.safetensors

4.83 GB
xet

Upload folder using huggingface_hub 11 months ago
model-00002-of-00003.safetensors

4.96 GB
xet

Upload folder using huggingface_hub 11 months ago
model-00003-of-00003.safetensors

4.51 GB
xet

Upload folder using huggingface_hub 11 months ago
model.safetensors.index.json

34.5 kB

Upload folder using huggingface_hub about 1 year ago
modeling_phi3.py

73.8 kB

Upload folder using huggingface_hub about 1 year ago
recipe.yaml

394 Bytes

Upload folder using huggingface_hub 11 months ago
results_2024-07-10T15-10-40.715163.json

119 kB

Upload folder using huggingface_hub about 1 year ago
sample_finetune.py

6.19 kB

Upload folder using huggingface_hub 11 months ago
special_tokens_map.json

569 Bytes

Upload folder using huggingface_hub about 1 year ago
tokenizer.json

1.84 MB

Upload folder using huggingface_hub 11 months ago
tokenizer.model

500 kB
xet

Upload folder using huggingface_hub about 1 year ago
tokenizer_config.json

3.19 kB

Upload folder using huggingface_hub about 1 year ago