Examples dataset used for GPTQ Calibration
#4
by
bullerwins
- opened
Hi!
Could you provide what dataset was use for the model.quantize(examples) calibration?
Hi here @bullerwins , sorry for the delay, there's a section in the README.md on how to reproduce the quantization.
In this case we used Salesforce/wikitext but you could use any other dataset, such as e.g. HuggingFaceTB/cosmopedia.
alvarobartt
changed discussion status to
closed