Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
NilayR
/
llama32-iterative-dpo-iter2
like
0
PEFT
Safetensors
llama
dpo
lora
llama-3.2
iterative-dpo
self-rewarding
4-bit precision
bitsandbytes
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Use this model
main
llama32-iterative-dpo-iter2
Ctrl+K
Ctrl+K
1 contributor
History:
12 commits
NilayR
Upload model
2d7348d
verified
1 day ago
.gitattributes
Safe
1.57 kB
Upload tokenizer
2 days ago
README.md
4.54 kB
Update README.md
1 day ago
adapter_config.json
895 Bytes
Upload model
1 day ago
adapter_model.safetensors
13.6 MB
xet
Upload model
1 day ago
chat_template.jinja
Safe
3.83 kB
Upload tokenizer
2 days ago
config.json
Safe
1.35 kB
Upload LlamaForCausalLM
2 days ago
generation_config.json
Safe
184 Bytes
Upload LlamaForCausalLM
2 days ago
model.safetensors
Safe
1.03 GB
xet
Upload LlamaForCausalLM
2 days ago
special_tokens_map.json
Safe
325 Bytes
Upload tokenizer
2 days ago
tokenizer.json
Safe
17.2 MB
xet
Upload tokenizer
2 days ago
tokenizer_config.json
Safe
50.6 kB
Upload tokenizer
2 days ago
