fbaldassarri
/

tiiuae_Falcon3-1B-Base-autogptq-int4-gs128-asym

Text Generation

intel-autoround

text-generation-inference

4-bit precision

Model card Files Files and versions Community

fbaldassarri commited on 13 days ago

Commit

969e0e3

·

verified ·

1 Parent(s): 12b1a7b

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ base_model:
   - tiiuae/Falcon3-1B-Base
 inference: false
 library_name: transformers
-model_creator: microsoft
 prompt_template: '{prompt} '
 quantized_by: fbaldassarri
 ---
@@ -40,7 +40,7 @@ Quantized version of [tiiuae/Falcon3-1B-Base](https://huggingface.co/tiiuae/Falc
 Quantization framework: [Intel AutoRound](https://github.com/intel/auto-round) v0.4.4
-Note: this INT4 version of Phi-4 has been quantized to run inference through CPU.
 ## Replication Recipe

   - tiiuae/Falcon3-1B-Base
 inference: false
 library_name: transformers
+model_creator: tiiuae
 prompt_template: '{prompt} '
 quantized_by: fbaldassarri
 ---
 Quantization framework: [Intel AutoRound](https://github.com/intel/auto-round) v0.4.4
+Note: this INT4 version of Falcon3-1B-Base has been quantized to run inference through CPU.
 ## Replication Recipe