
Cloud/Datacenter
Validated models ready for Arm cloud & datacenter platforms with tailor-made Learning Paths to guide you through your Arm development and deployment
Text Generation • Updated • 6.12M • • 3.88kNote Run a Large Language Model (LLM) chatbot with PyTorch using KleidiAI on Arm servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/pytorch-llama/
Qwen/Qwen2-0.5B-Instruct
Text Generation • Updated • 226k • 186Note Run an LLM chatbot with rtp-llm on Arm-based servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/rtp-llm/
Qwen/Qwen2.5-0.5B-Instruct
Text Generation • Updated • 1.04M • 314Note Build and Run a Virtual Large Language Model (vLLM) on Arm Servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/vllm/
distilbert/distilbert-base-uncased-finetuned-sst-2-english
Text Classification • Updated • 5.67M • 741Note Discover how to Accelerate NLP models from Hugging Face on Arm servers with DistilBERT - https://learn.arm.com/learning-paths/servers-and-cloud-computing/benchmark-nlp/
cognitivecomputations/dolphin-2.9.4-llama3.1-8b
Updated • 5.33k • 95Note Learn how you can build a RAG application using Zilliz Cloud on Arm servers with Dolphin 2.9.4-llama3.1-8b - https://learn.arm.com/learning-paths/servers-and-cloud-computing/milvus-rag/ You can also deploy a Large Language Model (LLM) chatbot with llama.cpp using KleidiAI on Arm servers with this model - https://learn.arm.com/learning-paths/servers-and-cloud-computing/llama-cpu/
chatpdflocal/llama3.1-8b-gguf
Updated • 337 • 26Note Deploy a RAG-based Chatbot with llama-cpp-python using KleidiAI on Google Axion processors - https://learn.arm.com/learning-paths/servers-and-cloud-computing/rag/
cardiffnlp/twitter-roberta-base-sentiment-latest
Text Classification • Updated • 2.05M • 668Note Run a Natural Language Processing (NLP) model from Hugging Face on Arm servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/nlp-hugging-face/
sentence-transformers/all-MiniLM-L6-v2
Sentence Similarity • Updated • 84.5M • • 3.3kNote Learn how you can Build a RAG application using Zilliz Cloud on Arm servers with all-MiniLM - https://learn.arm.com/learning-paths/servers-and-cloud-computing/milvus-rag/