vaidehiBhamare
/

jina1

Feature Extraction

sentence-transformers

sentence-similarity

text-embeddings-inference

Model card Files Files and versions Community

vaidehiBhamare commited on May 28

Commit

2a19f8c

·

verified ·

1 Parent(s): 6b346dc

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -33,7 +33,7 @@
   "num_hidden_layers": 24,
   "output_past": true,
   "pad_token_id": 1,
-  "position_embedding_type": "rotary",
   "rotary_emb_base": 20000.0,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.2",

   "num_hidden_layers": 24,
   "output_past": true,
   "pad_token_id": 1,
+  "position_embedding_type": "rope",
   "rotary_emb_base": 20000.0,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.2",