pull llama2:13bSee the full set of parameters on the API reference pagefrom langchain.llms import Ollamallm = Ollama(model="llama2:13b")llm("The first man on the moon was ... think step by step")    ' Sure! Here\'s the answer, broken down step by step:\n\nThe first man on the moon was... Neil Armstrong.\n\nHere\'s how I arrived at that answer:\n\n1. The first manned mission to land on the moon was Apollo 11.\n2. The mission included three astronauts: Neil Armstrong, Edwin "Buzz" Aldrin, and Michael Collins.\n3. Neil Armstrong was the mission commander and the first person to set foot on the moon.\n4. On July 20, 1969, Armstrong stepped out of the lunar module Eagle and onto the moon\'s surface, famously declaring "That\'s one small step for man, one giant leap for mankind."\n\nSo, the first man on the moon was Neil Armstrong!'Llama.cpp‚ÄãLlama.cpp is compatible with a broad set of models.For example, below we run inference on llama2-13b with 4 bit quantization downloaded from HuggingFace.As noted above, see the API reference for the full set of parameters. From the llama.cpp docs, a few are worth commenting on:n_gpu_layers: number of layers to be loaded into GPU memoryValue: 1Meaning: Only one layer of the model will be loaded into GPU memory (1 is often sufficient).n_batch: number of tokens the model should process in parallel Value: n_batchMeaning: It's recommended to choose a value between 1 and n_ctx (which in this case is set to 2048)n_ctx: Token context window .Value: 2048Meaning: The model will consider a window of 2048 tokens at a timef16_kv: whether the model should use half-precision for the key/value cacheValue: TrueMeaning: The model will use half-precision, which can be more memory efficient; Metal only support True.CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install -U llama-cpp-python --no-cache-dirclearfrom langchain.llms import LlamaCppllm = LlamaCpp(    model_path="/Users/rlm/Desktop/Code/llama.cpp/models/openorca-platypus2-13b.gguf.q4_0.bin",
Use case
Use case ->: pull llama2:13bSee the full set of parameters on the API reference pagefrom langchain.llms import Ollamallm = Ollama(model="llama2:13b")llm("The first man on the moon was ... think step by step")    ' Sure! Here\'s the answer, broken down step by step:\n\nThe first man on the moon was... Neil Armstrong.\n\nHere\'s how I arrived at that answer:\n\n1. The first manned mission to land on the moon was Apollo 11.\n2. The mission included three astronauts: Neil Armstrong, Edwin "Buzz" Aldrin, and Michael Collins.\n3. Neil Armstrong was the mission commander and the first person to set foot on the moon.\n4. On July 20, 1969, Armstrong stepped out of the lunar module Eagle and onto the moon\'s surface, famously declaring "That\'s one small step for man, one giant leap for mankind."\n\nSo, the first man on the moon was Neil Armstrong!'Llama.cpp‚ÄãLlama.cpp is compatible with a broad set of models.For example, below we run inference on llama2-13b with 4 bit quantization downloaded from HuggingFace.As noted above, see the API reference for the full set of parameters. From the llama.cpp docs, a few are worth commenting on:n_gpu_layers: number of layers to be loaded into GPU memoryValue: 1Meaning: Only one layer of the model will be loaded into GPU memory (1 is often sufficient).n_batch: number of tokens the model should process in parallel Value: n_batchMeaning: It's recommended to choose a value between 1 and n_ctx (which in this case is set to 2048)n_ctx: Token context window .Value: 2048Meaning: The model will consider a window of 2048 tokens at a timef16_kv: whether the model should use half-precision for the key/value cacheValue: TrueMeaning: The model will use half-precision, which can be more memory efficient; Metal only support True.CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install -U llama-cpp-python --no-cache-dirclearfrom langchain.llms import LlamaCppllm = LlamaCpp(    model_path="/Users/rlm/Desktop/Code/llama.cpp/models/openorca-platypus2-13b.gguf.q4_0.bin",