JayHyeon
/

Qwen_1.5B-BDPO_5e-7-3ep_0.5bdpo_lambda

Text Generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions Community

Qwen_1.5B-BDPO_5e-7-3ep_0.5bdpo_lambda

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

JayHyeon's picture

Training in progress, step 2910

8b9acb4 verified 24 days ago

.gitattributes

1.57 kB

Training in progress, step 1000 24 days ago
added_tokens.json

605 Bytes

Training in progress, step 1000 24 days ago
config.json

685 Bytes

Training in progress, step 1000 24 days ago
merges.txt

1.67 MB

Training in progress, step 1000 24 days ago
model.safetensors

3.55 GB
LFS

Training in progress, step 2910 24 days ago
special_tokens_map.json

613 Bytes

Training in progress, step 1000 24 days ago
tokenizer.json

11.4 MB
LFS

Training in progress, step 1000 24 days ago
tokenizer_config.json

7.34 kB

Training in progress, step 1000 24 days ago
training_args.bin
Detected Pickle imports (15)
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "trl.trainer.dpo_config.FDivergenceType",
- "transformers.trainer_utils.HubStrategy",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "torch.bfloat16",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.IntervalStrategy",
- "trl.trainer.dpo_config.DPOConfig",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SaveStrategy",
- "torch.device"
How to fix it?
7.8 kB
LFS

Training in progress, step 1000 24 days ago
vocab.json

2.78 MB

Training in progress, step 1000 24 days ago