After logging in, run the command onscreen to check whether the server is ready. When it is ready, you can start using the Takeoff integration.To shutdown the server, run the following command. You will be presented with options on which Takeoff server to shut down, in case you have multiple running servers.iris takeoff --shutdown # shutdown the serverInferencing your model‚ÄãTo access your LLM, use the TitanTakeoff LLM wrapper:from langchain.llms import TitanTakeoffllm = TitanTakeoff(    baseURL="http://localhost:8000",    generate_max_length=128,    temperature=1.0)prompt = "What is the largest planet in the solar system?"llm(prompt)No parameters are needed by default, but a baseURL that points to your desired URL where Takeoff is running can be specified and generation parameters can be supplied.Streaming‚ÄãStreaming is also supported via the streaming flag:from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandlerfrom langchain.callbacks.manager import CallbackManagerllm = TitanTakeoff(callback_manager=CallbackManager([StreamingStdOutCallbackHandler()]), streaming=True)prompt = "What is the capital of France?"llm(prompt)Integration with LLMChain‚Äãfrom langchain.prompts import PromptTemplatefrom langchain.chains import LLMChainllm = TitanTakeoff()template = "What is the capital of {country}"prompt = PromptTemplate(template=template, input_variables=["country"])llm_chain = LLMChain(llm=llm, prompt=prompt)generated = llm_chain.run(country="Belgium")print(generated)PreviousTextGenNextTogether AIInstallationChoose a ModelTaking offInferencing your modelStreamingIntegration with LLMChainCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.
TitanML helps businesses build and deploy better, smaller, cheaper, and faster NLP models through our training, compression, and inference optimization platform.
TitanML helps businesses build and deploy better, smaller, cheaper, and faster NLP models through our training, compression, and inference optimization platform. ->: After logging in, run the command onscreen to check whether the server is ready. When it is ready, you can start using the Takeoff integration.To shutdown the server, run the following command. You will be presented with options on which Takeoff server to shut down, in case you have multiple running servers.iris takeoff --shutdown # shutdown the serverInferencing your model‚ÄãTo access your LLM, use the TitanTakeoff LLM wrapper:from langchain.llms import TitanTakeoffllm = TitanTakeoff(    baseURL="http://localhost:8000",    generate_max_length=128,    temperature=1.0)prompt = "What is the largest planet in the solar system?"llm(prompt)No parameters are needed by default, but a baseURL that points to your desired URL where Takeoff is running can be specified and generation parameters can be supplied.Streaming‚ÄãStreaming is also supported via the streaming flag:from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandlerfrom langchain.callbacks.manager import CallbackManagerllm = TitanTakeoff(callback_manager=CallbackManager([StreamingStdOutCallbackHandler()]), streaming=True)prompt = "What is the capital of France?"llm(prompt)Integration with LLMChain‚Äãfrom langchain.prompts import PromptTemplatefrom langchain.chains import LLMChainllm = TitanTakeoff()template = "What is the capital of {country}"prompt = PromptTemplate(template=template, input_variables=["country"])llm_chain = LLMChain(llm=llm, prompt=prompt)generated = llm_chain.run(country="Belgium")print(generated)PreviousTextGenNextTogether AIInstallationChoose a ModelTaking offInferencing your modelStreamingIntegration with LLMChainCommunityDiscordTwitterGitHubPythonJS/TSMoreHomepageBlogCopyright ¬© 2023 LangChain, Inc.