Langchain, Llm, Generative Ai Tools, Large Language Models, Llmops.
some overlap (to keep context between chunks). from langchain.text_splitter import CharacterTextSplitter text_splitter = CharacterTextSplitter(chunk_size=1000, chunk_overlap=150) texts = text_splitter.split_documents(documents) Select the embeddings you want to use and create a vector store to use