Hugging Face's logo

Jeyong
/
SOLAR-10.7B-dpo-v1-awq

Text Generation
Transformers
Safetensors
Korean
llama
SOLAR-10.7B
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community

SOLAR-10.7B

Model Details

Quantization

  • AWQ applied using following parameters.
    • zero_point: True
    • q_group_size: 128
    • w_bit: 4
    • version: GEMM
Downloads last month
7
Safetensors
Model size
1.78B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.