NoorNizar
/

Phi-4-mini-instruct-WINT4

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Phi-4-mini-instruct-WINT4 / generation_config.json

NoorNizar's picture

Upload 4-bit int quantized model via script

22ccf76 verified 2 months ago

169 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 199999,
	"eos_token_id": [
	200020,
	199999
	],
	"pad_token_id": 199999,
	"transformers_version": "4.50.0"
	}