Your web endpoint will acquire a persistent URL under the modal.run domain.LLM wrapper around Modal web endpoint‚ÄãThe  Modal LLM wrapper class which will accept your deployed web endpoint's URL.from langchain.llms import Modalendpoint_url = "https://ecorp--custom-llm-endpoint.modal.run"  # REPLACE ME with your deployed Modal web endpoint's URLllm = Modal(endpoint_url=endpoint_url)llm_chain = LLMChain(prompt=prompt, llm=llm)question = "What NFL team won the Super Bowl in the year Justin Beiber was born?"llm_chain.run(question)PreviousMLflowNextModelScopeInstallation and SetupDefine your Modal Functions and WebhooksDeploy the web endpointLLM wrapper around Modal web endpointCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.
This page covers how to use the Modal ecosystem to run LangChain custom LLMs.
This page covers how to use the Modal ecosystem to run LangChain custom LLMs. ->: Your web endpoint will acquire a persistent URL under the modal.run domain.LLM wrapper around Modal web endpoint‚ÄãThe  Modal LLM wrapper class which will accept your deployed web endpoint's URL.from langchain.llms import Modalendpoint_url = "https://ecorp--custom-llm-endpoint.modal.run"  # REPLACE ME with your deployed Modal web endpoint's URLllm = Modal(endpoint_url=endpoint_url)llm_chain = LLMChain(prompt=prompt, llm=llm)question = "What NFL team won the Super Bowl in the year Justin Beiber was born?"llm_chain.run(question)PreviousMLflowNextModelScopeInstallation and SetupDefine your Modal Functions and WebhooksDeploy the web endpointLLM wrapper around Modal web endpointCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.