EmbeddingsRedundantFilter we can identify similar documents and filter out redundancies. With integrations like
doctran we can do things like translate documents from one language
to another, extract desired properties and add them to metadata, and convert conversational dialogue into a Q/A format
set of documents.PreviousPDFNextHTMLHeaderTextSplitterText splittersGet started with text splittersOther transformations:Filter redundant docs, translate docs, extract metadata, and moreCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.
Head to Integrations for documentation on built-in document transformer integrations with 3rd-party tools.
Head to Integrations for documentation on built-in document transformer integrations with 3rd-party tools. ->: EmbeddingsRedundantFilter we can identify similar documents and filter out redundancies. With integrations like
doctran we can do things like translate documents from one language
to another, extract desired properties and add them to metadata, and convert conversational dialogue into a Q/A format
set of documents.PreviousPDFNextHTMLHeaderTextSplitterText splittersGet started with text splittersOther transformations:Filter redundant docs, translate docs, extract metadata, and moreCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.