Introduction to vector similarity search (2022)
Can anyone please suggest a good stack for the following:<p>- calculating text embeddings using open-source/local methods (not OpenAI)<p>- storing them in a vector database. I'm confused by the myriad of options like Chromadb, Pinecone, etc.<p>- running vector similarity search using open-source/local methods.<p>Also, how granular should the text chunks be? Too short and we'll end up with a huge database, too long and we'll probably miss some relevant information in some chunks.<p>Has anyone been able to achieve reliable results from these? Preferably w/o using Langchain.