gte-Qwen2-1.5B-instruct-GGUF
Original Model
Alibaba-NLP/gte-Qwen2-1.5B-instruct
Run with Gaianet
Prompt template:
prompt template: embedding
Context size:
chat_ctx_size: 32000
Run with GaiaNet:
Quick start with gte-Qwen2-1.5B-instruct: https://github.com/GaiaNet-AI/node-configs/blob/main/gte-Qwen2-1.5B-instruct/README.md
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3259
- Downloads last month
- 43
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for gaianet/gte-Qwen2-1.5B-instruct-GGUF
Base model
Alibaba-NLP/gte-Qwen2-1.5B-instruct