R136a1/InfinityLake-2x7B AWQ

InfinityKuno-2x7B

Model Summary

Experimental model from Endevor/InfinityRP-v1-7B and senseable/WestLake-7B-v2 models. Merged to MoE model with 2x7B parameters.

Downloads last month
75
Safetensors
Model size
1.95B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for solidrust/InfinityLake-2x7B-AWQ

Quantized
(3)
this model

Collection including solidrust/InfinityLake-2x7B-AWQ