It is broken into three parts: installation and setup, LLMs, and Embeddings.Installation and Setup‚ÄãInstall the Python SDK with pip install runhouseIf you'd like to use on-demand cluster, check your cloud credentials with sky checkSelf-hosted LLMs‚ÄãFor a basic self-hosted LLM, you can use the SelfHostedHuggingFaceLLM class. For more
custom LLMs, you can use the SelfHostedPipeline parent class.from langchain.llms import SelfHostedPipeline, SelfHostedHuggingFaceLLMFor a more detailed walkthrough of the Self-hosted LLMs, see this notebookSelf-hosted Embeddings‚ÄãThere are several ways to use self-hosted embeddings with LangChain via Runhouse.For a basic self-hosted embedding from a Hugging Face Transformers model, you can use
the SelfHostedEmbedding class.from langchain.llms import SelfHostedPipeline, SelfHostedHuggingFaceLLMFor a more detailed walkthrough of the Self-hosted Embeddings, see this notebookPreviousRocksetNextRWKV-4Installation and SetupSelf-hosted LLMsSelf-hosted EmbeddingsCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.
This page covers how to use the Runhouse ecosystem within LangChain.
This page covers how to use the Runhouse ecosystem within LangChain. ->: It is broken into three parts: installation and setup, LLMs, and Embeddings.Installation and Setup‚ÄãInstall the Python SDK with pip install runhouseIf you'd like to use on-demand cluster, check your cloud credentials with sky checkSelf-hosted LLMs‚ÄãFor a basic self-hosted LLM, you can use the SelfHostedHuggingFaceLLM class. For more
custom LLMs, you can use the SelfHostedPipeline parent class.from langchain.llms import SelfHostedPipeline, SelfHostedHuggingFaceLLMFor a more detailed walkthrough of the Self-hosted LLMs, see this notebookSelf-hosted Embeddings‚ÄãThere are several ways to use self-hosted embeddings with LangChain via Runhouse.For a basic self-hosted embedding from a Hugging Face Transformers model, you can use
the SelfHostedEmbedding class.from langchain.llms import SelfHostedPipeline, SelfHostedHuggingFaceLLMFor a more detailed walkthrough of the Self-hosted Embeddings, see this notebookPreviousRocksetNextRWKV-4Installation and SetupSelf-hosted LLMsSelf-hosted EmbeddingsCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.