It is broken into two parts: installation and setup, and then references to specific Llama-cpp wrappers.Installation and Setup‚ÄãInstall the Python package with pip install llama-cpp-pythonDownload one of the supported models and convert them to the llama.cpp format per the instructionsWrappers‚ÄãLLM‚ÄãThere exists a LlamaCpp LLM wrapper, which you can access with from langchain.llms import LlamaCppFor a more detailed walkthrough of this, see this notebookEmbeddings‚ÄãThere exists a LlamaCpp Embeddings wrapper, which you can access with from langchain.embeddings import LlamaCppEmbeddingsFor a more detailed walkthrough of this, see this notebookPreviousLangChain Decorators ‚ú®NextLog10Installation and SetupWrappersLLMEmbeddingsCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.
This page covers how to use llama.cpp within LangChain.
This page covers how to use llama.cpp within LangChain. ->: It is broken into two parts: installation and setup, and then references to specific Llama-cpp wrappers.Installation and Setup‚ÄãInstall the Python package with pip install llama-cpp-pythonDownload one of the supported models and convert them to the llama.cpp format per the instructionsWrappers‚ÄãLLM‚ÄãThere exists a LlamaCpp LLM wrapper, which you can access with from langchain.llms import LlamaCppFor a more detailed walkthrough of this, see this notebookEmbeddings‚ÄãThere exists a LlamaCpp Embeddings wrapper, which you can access with from langchain.embeddings import LlamaCppEmbeddingsFor a more detailed walkthrough of this, see this notebookPreviousLangChain Decorators ‚ú®NextLog10Installation and SetupWrappersLLMEmbeddingsCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.