Benchmark results compared to orig fp8 / int4 quants etc?
#1
by
CHNtentes
- opened
Can you evaluate this fp4 quant? How it compares to others out there.
Do we have ppl score for FP4 data type? Thank you very much.