akameswa
/

mistral-7b-instruct-code-ties

Text Generation

jiayihao03/mistral-7b-instruct-Javascript-4bit

jiayihao03/mistral-7b-instruct-python-4bit

akameswa/mistral-7b-instruct-java-4bit

akameswa/mistral-7b-instruct-go-4bit

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mistral-7b-instruct-code-ties / mergekit_config.yml

akameswa's picture

Upload folder using huggingface_hub

83e6c44 verified 7 months ago

history blame contribute delete

610 Bytes


	models:
	- model: unsloth/mistral-7b-instruct-v0.2-bnb-4bit
	- model: jiayihao03/mistral-7b-instruct-Javascript-4bit
	parameters:
	density: 0.85
	weight: 0.25
	- model: jiayihao03/mistral-7b-instruct-python-4bit
	parameters:
	density: 0.85
	weight: 0.25
	- model: akameswa/mistral-7b-instruct-java-4bit
	parameters:
	density: 0.85
	weight: 0.25
	- model: akameswa/mistral-7b-instruct-go-4bit
	parameters:
	density: 0.85
	weight: 0.25
	merge_method: ties
	base_model: unsloth/mistral-7b-instruct-v0.2-bnb-4bit
	parameters:
	normalize: true
	dtype: float16