Jeyong
/

SOLAR-10.7B-dpo-v1-awq

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

SOLAR-10.7B

Model Details

Base Model: hyeogi/SOLAR-10.7B-dpo-v1

Quantization

AWQ applied using following parameters.
- zero_point: True
- q_group_size: 128
- w_bit: 4
- version: GEMM

Downloads last month: 32

Safetensors

Model size

1.78B params

Tensor type

I32

·

F16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support