Abouth w8a8 method

by a-r-c - opened Dec 5, 2024

a-r-c

Dec 5, 2024

What quantize method you use

Owner Dec 8, 2024

GPTQ Int8 for weights.

Jan 13

Is this padded for multi-GPU use?

Jan 13

•

edit

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment