ehristoforu
/

refrankenqwen2.5-7b-it

Text Generation

text-generation-inference

Model card Files Files and versions

refrankenqwen2.5-7b-it / mergekit_config.yml

ehristoforu's picture

Upload folder using huggingface_hub

c740dff verified 8 months ago

history blame contribute delete

597 Bytes

	slices:
	- sources:
	- model: Qwen/Qwen2.5-7B-Instruct
	layer_range: [0, 4]
	- sources:
	- model: Qwen/Qwen2.5-7B-Instruct
	layer_range: [4, 8]
	- sources:
	- model: Qwen/Qwen2.5-7B-Instruct
	layer_range: [8, 12]
	- sources:
	- model: Qwen/Qwen2.5-7B-Instruct
	layer_range: [12, 16]
	- sources:
	- model: Qwen/Qwen2.5-7B-Instruct
	layer_range: [16, 20]
	- sources:
	- model: Qwen/Qwen2.5-7B-Instruct
	layer_range: [20, 24]
	- sources:
	- model: Qwen/Qwen2.5-7B-Instruct
	layer_range: [24, 28]
	merge_method: passthrough
	dtype: float16