skowshik
/

llama31-8B-pretraining-deepspeed-cleaned-lr-5e7-bs-4

Model card Files Files and versions Community

llama31-8B-pretraining-deepspeed-cleaned-lr-5e7-bs-4

Ctrl+K

Ctrl+K

1 contributor

History: 30 commits

skowshik's picture

Training in progress, step 3800

000e4d1 verified 3 months ago

.gitattributes

1.57 kB

Training in progress, step 200 3 months ago
adapter_config.json

739 Bytes

Training in progress, step 200 3 months ago
adapter_model.safetensors

42 MB
LFS

Training in progress, step 3800 3 months ago
special_tokens_map.json

325 Bytes

Training in progress, step 200 3 months ago
tokenizer.json

17.2 MB
LFS

Training in progress, step 200 3 months ago
tokenizer_config.json

55.5 kB

Training in progress, step 200 3 months ago
training_args.bin
Detected Pickle imports (13)
- "trl.trainer.sft_config.SFTConfig",
- "transformers.trainer_utils.IntervalStrategy",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.training_args.OptimizerNames",
- "accelerate.state.PartialState",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "transformers.trainer_utils.HubStrategy",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.trainer_utils.SchedulerType",
- "torch.bfloat16",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType"
How to fix it?
6.9 kB
LFS

Training in progress, step 200 3 months ago