AI-Engine/Phi-3-medium-128k-instruct-GGUF

NOTE: Requires 128k context support -> https://github.com/ggerganov/llama.cpp/releases/tag/b2961.

GGUF llama.cpp quantized version of:

• Original model: Microsoft/Phi-3-medium-128k-instruct
• Model creator: Microsoft
• License

Recommended Prompt Format (Chat Format)

<|user|>
Provide some context and/or instructions to the model.<|end|>
<|assistant|>
AI message goes here<|end|>
<|user|>
The user’s message goes here<|end|>
<|assistant|>