qingy2024
/

UIGEN-X-8B-QAT-FFT-AWQ

compressed-tensors

Model card Files Files and versions

UIGEN-X-8B-QAT-FFT-AWQ / recipe.yaml

qingy2024's picture

Upload folder using huggingface_hub

e3c4f36 verified about 1 month ago

history blame contribute delete

171 Bytes

	default_stage:
	default_modifiers:
	AWQModifier:
	targets: [Linear]
	ignore: [lm_head, 're:.mlp.gate$', 're:.mlp.shared_expert_gate$']
	scheme: W4A16