codemalt / config.json
Sarthak
feat(config): add new model type for vector embeddings
53a6528
raw
history blame contribute delete
299 Bytes
{
"model_type": "model2vec",
"architectures": [
"StaticModel"
],
"tokenizer_name": "sentence-transformers/all-mpnet-base-v2",
"apply_pca": 256,
"apply_zipf": true,
"sif_coefficient": 0.001,
"hidden_dim": 256,
"seq_length": 1000000,
"normalize": true
}