Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
X1716
/
llm-course-hw2-reward-model
like
0
Text Classification
Transformers
Safetensors
HumanLLMs/Human-Like-DPO-Dataset
English
llama
Generated from Trainer
trl
reward-trainer
text-generation-inference
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
llm-course-hw2-reward-model
1 contributor
History:
7 commits
X1716
Update README.md
354432e
verified
5 days ago
.gitattributes
Safe
1.52 kB
initial commit
11 days ago
README.md
2.27 kB
Update README.md
5 days ago
config.json
784 Bytes
X1716/llm-course-hw2-reward-model
10 days ago
merges.txt
Safe
466 kB
X1716/llm-course-hw2-reward-model
11 days ago
model.safetensors
538 MB
LFS
X1716/llm-course-hw2-reward-model
10 days ago
special_tokens_map.json
Safe
541 Bytes
X1716/llm-course-hw2-reward-model
10 days ago
tokenizer.json
Safe
3.52 MB
X1716/llm-course-hw2-reward-model
11 days ago
tokenizer_config.json
Safe
3.62 kB
X1716/llm-course-hw2-reward-model
10 days ago
training_args.bin
pickle
Detected Pickle imports (10)
"transformers.training_args.OptimizerNames"
,
"transformers.trainer_utils.HubStrategy"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.trainer_utils.SaveStrategy"
,
"accelerate.state.PartialState"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"transformers.trainer_utils.SchedulerType"
,
"torch.device"
,
"transformers.trainer_utils.IntervalStrategy"
,
"trl.trainer.reward_config.RewardConfig"
How to fix it?
5.43 kB
LFS
X1716/llm-course-hw2-reward-model
10 days ago
vocab.json
Safe
801 kB
X1716/llm-course-hw2-reward-model
11 days ago