of the following variables.set FORCE_CMAKE=1set CMAKE_ARGS=-DLLAMA_CUBLAS=OFFYou can ignore the second environment variable if you have an NVIDIA GPU.Compiling and installing‚ÄãIn the same command prompt (anaconda prompt) you set the variables, you can cd into llama-cpp-python directory and run the following commands.python setup.py cleanpython setup.py installUsage‚ÄãMake sure you are following all instructions to install all necessary model files.You don't need an API_TOKEN as you will run the LLM locally.It is worth understanding which models are suitable to be used on the desired machine.from langchain.llms import LlamaCppfrom langchain.prompts import PromptTemplatefrom langchain.chains import LLMChainfrom langchain.callbacks.manager import CallbackManagerfrom langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandlerConsider using a template that suits your model! Check the models page on HuggingFace etc. to get a correct prompting template.template = """Question: {question}Answer: Let's work this out in a step by step way to be sure we have the right answer."""prompt = PromptTemplate(template=template, input_variables=["question"])# Callbacks support token-wise streamingcallback_manager = CallbackManager([StreamingStdOutCallbackHandler()])CPU‚ÄãExample using a LLaMA 2 7B model# Make sure the model path is correct for your system!llm = LlamaCpp(    model_path="/Users/rlm/Desktop/Code/llama.cpp/models/openorca-platypus2-13b.gguf.q4_0.bin",    temperature=0.75,    max_tokens=2000,    top_p=1,    callback_manager=callback_manager,     verbose=True, # Verbose is required to pass to the callback manager)prompt = """Question: A rap battle between Stephen Colbert and John Oliver"""llm(prompt)        Stephen Colbert:    Yo, John, I heard you've been talkin' smack about me on your show.    Let me tell you somethin', pal, I'm the king of late-night TV    My satire is sharp as a razor, it cuts deeper than a knife    While you're just a british bloke
llama-cpp-python is a Python binding for llama.cpp.
llama-cpp-python is a Python binding for llama.cpp. ->: of the following variables.set FORCE_CMAKE=1set CMAKE_ARGS=-DLLAMA_CUBLAS=OFFYou can ignore the second environment variable if you have an NVIDIA GPU.Compiling and installing‚ÄãIn the same command prompt (anaconda prompt) you set the variables, you can cd into llama-cpp-python directory and run the following commands.python setup.py cleanpython setup.py installUsage‚ÄãMake sure you are following all instructions to install all necessary model files.You don't need an API_TOKEN as you will run the LLM locally.It is worth understanding which models are suitable to be used on the desired machine.from langchain.llms import LlamaCppfrom langchain.prompts import PromptTemplatefrom langchain.chains import LLMChainfrom langchain.callbacks.manager import CallbackManagerfrom langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandlerConsider using a template that suits your model! Check the models page on HuggingFace etc. to get a correct prompting template.template = """Question: {question}Answer: Let's work this out in a step by step way to be sure we have the right answer."""prompt = PromptTemplate(template=template, input_variables=["question"])# Callbacks support token-wise streamingcallback_manager = CallbackManager([StreamingStdOutCallbackHandler()])CPU‚ÄãExample using a LLaMA 2 7B model# Make sure the model path is correct for your system!llm = LlamaCpp(    model_path="/Users/rlm/Desktop/Code/llama.cpp/models/openorca-platypus2-13b.gguf.q4_0.bin",    temperature=0.75,    max_tokens=2000,    top_p=1,    callback_manager=callback_manager,     verbose=True, # Verbose is required to pass to the callback manager)prompt = """Question: A rap battle between Stephen Colbert and John Oliver"""llm(prompt)        Stephen Colbert:    Yo, John, I heard you've been talkin' smack about me on your show.    Let me tell you somethin', pal, I'm the king of late-night TV    My satire is sharp as a razor, it cuts deeper than a knife    While you're just a british bloke