GGUF
conversational
mohit-sarvam commited on
Commit
b94041b
·
verified ·
1 Parent(s): f4f3782

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - sarvamai/sarvam-m
5
+ ---
6
+
7
+ # Sarvam-M
8
+ <p align="center">
9
+ <a href="https://dashboard.sarvam.ai/playground"
10
+ target="_blank" rel="noopener noreferrer">
11
+ <img
12
+ src="https://img.shields.io/badge/🚀 Chat on Sarvam&nbsp;Playground-1488CC?style=for-the-badge&logo=rocket"
13
+ alt="Chat on Sarvam Playground"
14
+ />
15
+ </a>
16
+ </p>
17
+
18
+ # Model Information
19
+
20
+ > [!Note]
21
+ > This repository contains gguf version of `sarvam-m` in q8 precision.
22
+ >
23
+ > You can find the safetensors files [here](https://huggingface.co/sarvamai/sarvam-m).
24
+
25
+ Learn more about sarvam-m in our detailed [blog post](https://www.sarvam.ai/blogs/sarvam-m).
26
+
27
+ # Running the model on a CPU
28
+
29
+ You can use the model on your local machine (without gpu) as explained [here](https://github.com/ggml-org/llama.cpp/tree/master/tools/main).
30
+
31
+ Example Command:
32
+ ```
33
+ ./build/bin/llama-cli -i -m /your/folder/path/sarvam-m-q8_0.gguf -c 8192 -t 16
34
+ ```