LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper • 2312.11514 • Published • 264
llm-local
-
-
Transformers to Core ML
⚡97Display a loading screen with a spinner
-
enterprise-explorers/Llama-2-7b-chat-coreml
Text Generation • Updated • 3.24k • 136 -
tiiuae/falcon-7b-instruct
Text Generation • 7B • Updated • 124k • 1.03k -
TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF
47B • Updated • 18.6k • 654 -
TheBloke/Mistral-7B-Instruct-v0.2-GGUF
Text Generation • 7B • Updated • 182k • 504