RedHatAI
/

granite-3.1-8b-base-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions Community

Update README.md

#1

by ekurtic - opened 8 days ago

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ library_name: transformers
   - **Output:** Text
 - **Model Optimizations:**
   - **Weight quantization:** INT4
-  - **Activation quantization:** INT4
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
 - **Model Developers:** Neural Magic

   - **Output:** Text
 - **Model Optimizations:**
   - **Weight quantization:** INT4
+  - **Activation quantization:** BF16
 - **Release Date:** 1/8/2025
 - **Version:** 1.0
 - **Model Developers:** Neural Magic