Retrieval in LangChain
I've been playing around with sentence embeddings to search documents, but I wonder how useful they are as a natural language interface for a database. The way one might phrase a question might be very different content wise from how the document describes the answer. Maybe it might be possible to do some type of transform where the question is transformed into a possible answer and then turned into a embedding but I haven't found much info on that yet.Another idea I've had is to "overfit" a generative model like GPT on a dataset but pay more attention to how url and the like are tokenised