learning_rate: 5.0e-6

num_train_epochs: 4

per_device_train_batch_size: 2

gradient_accumulation_steps: 8

Downloads last month
30
Safetensors
Model size
473M params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lblaoke/qwama-0.5b-skywork-pref-dpo-trl-v2

Finetuned
(6)
this model

Dataset used to train lblaoke/qwama-0.5b-skywork-pref-dpo-trl-v2

Collection including lblaoke/qwama-0.5b-skywork-pref-dpo-trl-v2