Show HN: Llama2 Embeddings FastAPI Server
It seems unlikely that raw llama2 will perform better than purpose made encoder models like bge [1], gte [2], e5 [3] or instructor, despite it's much much larger size (for the tasks people usually need embeddings for).<p>You can probably get it to behave well with a fine tuning like this: <a href="https://arxiv.org/pdf/2202.08904.pdf" rel="nofollow noreferrer">https://arxiv.org/pdf/2202.08904.pdf</a><p>[1] <a href="https://huggingface.co/BAAI/bge-large-en" rel="nofollow noreferrer">https://huggingface.co/BAAI/bge-large-en</a><p>[2] <a href="https://huggingface.co/thenlper/gte-large" rel="nofollow noreferrer">https://huggingface.co/thenlper/gte-large</a><p>[3] <a href="https://huggingface.co/intfloat/e5-large-v2" rel="nofollow noreferrer">https://huggingface.co/intfloat/e5-large-v2</a>