Show HN: Llama2 Embeddings FastAPI Server
It seems unlikely that raw llama2 will perform better than purpose made encoder models like bge [1], gte [2], e5 [3] or instructor, despite it's much much larger size (for the tasks people usually need embeddings for).You can probably get it to behave well with a fine tuning like this: https://arxiv.org/pdf/2202.08904.pdf[1] https://huggingface.co/BAAI/bge-large-en[2] https://huggingface.co/thenlper/gte-large[3] https://huggingface.co/intfloat/e5-large-v2