--- base_model: jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b inference: false library_name: transformers merged_models: - zhengr/MixTAO-7Bx2-MoE-v8.1 - jsfs11/MixtureofMerges-MoE-2x7b-v6 pipeline_tag: text-generation quantized_by: Suparious tags: - 4-bit - AWQ - text-generation - autotrain_compatible - endpoints_compatible - merge - mergekit - lazymergekit - zhengr/MixTAO-7Bx2-MoE-v8.1 - jsfs11/MixtureofMerges-MoE-2x7b-v6 --- # jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b AWQ - Model creator: [jsfs11](https://huggingface.co/jsfs11) - Original model: [MixtureofMerges-MoE-2x7b-SLERPv0.9b](https://huggingface.co/jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b) ## Model Summary MixtureofMerges-MoE-2x7b-SLERPv0.9b is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing): * [zhengr/MixTAO-7Bx2-MoE-v8.1](https://huggingface.co/zhengr/MixTAO-7Bx2-MoE-v8.1) * [jsfs11/MixtureofMerges-MoE-2x7b-v6](https://huggingface.co/jsfs11/MixtureofMerges-MoE-2x7b-v6)