askmyteapot
/

GPT4-x-AlpacaDente2-30b-4bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

askmyteapot commited on May 5, 2023

Commit

9914282

•

1 Parent(s): bb3f8f2

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -5,8 +5,8 @@
 # My secret sauce:
   * Using comit <a href="https://github.com/0cc4m/GPTQ-for-LLaMa/tree/3c16fd9c7946ebe85df8d951cb742adbc1966ec7">3c16fd9</a> of 0cc4m's GPTQ fork
   * Using PTB as the calibration dataset
-  * Act-order, True-sequential, perfdamp 0.1
-     (<i>the default perfdamp is 0.01</i>)
   * No groupsize
   * Will run with CUDA, does not need triton.
   * Quant completed on a 'Premium GPU' and 'High Memory' Google Colab.

 # My secret sauce:
   * Using comit <a href="https://github.com/0cc4m/GPTQ-for-LLaMa/tree/3c16fd9c7946ebe85df8d951cb742adbc1966ec7">3c16fd9</a> of 0cc4m's GPTQ fork
   * Using PTB as the calibration dataset
+  * Act-order, True-sequential, percdamp 0.1
+     (<i>the default percdamp is 0.01</i>)
   * No groupsize
   * Will run with CUDA, does not need triton.
   * Quant completed on a 'Premium GPU' and 'High Memory' Google Colab.