sigridjineth
/

ko-embedding-v1-preview-241130

Model card Files Files and versions

ko-embedding-v1-preview-241130

11.4 GB

1 contributor

History: 44 commits

sigridjineth's picture

Upload checkpoint-14/rng_state_5.pth with huggingface_hub

bdf43aa verified about 1 year ago

checkpoint-14
Upload checkpoint-14/rng_state_5.pth with huggingface_hub about 1 year ago
checkpoint-35
Upload checkpoint-35/global_step35/mp_rank_00_model_states.pt with huggingface_hub about 1 year ago
.gitattributes

1.57 kB

Upload tokenizer.json with huggingface_hub about 1 year ago
colbert_linear.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.1 MB
xet

Upload colbert_linear.pt with huggingface_hub about 1 year ago
config.json

787 Bytes

Upload config.json with huggingface_hub about 1 year ago
model.safetensors

1.14 GB
xet

Upload model.safetensors with huggingface_hub about 1 year ago
sentencepiece.bpe.model

5.07 MB
xet

Upload sentencepiece.bpe.model with huggingface_hub about 1 year ago
sparse_linear.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
3.52 kB
xet

Upload sparse_linear.pt with huggingface_hub about 1 year ago
special_tokens_map.json

964 Bytes

Upload special_tokens_map.json with huggingface_hub about 1 year ago
tokenizer.json

17.1 MB
xet

Upload tokenizer.json with huggingface_hub about 1 year ago
tokenizer_config.json

1.17 kB

Upload tokenizer_config.json with huggingface_hub about 1 year ago
training_args.bin
Detected Pickle imports (12)
- "torch.device",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "FlagEmbedding.finetune.embedder.encoder_only.m3.arguments.EncoderOnlyEmbedderM3TrainingArguments",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.state.PartialState",
- "torch.float16",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.trainer_utils.SchedulerType"
How to fix it?
7.03 kB
xet

Upload training_args.bin with huggingface_hub about 1 year ago