File size: 461 Bytes
ecd5d05
 
 
0314072
ecd5d05
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
---
license: mit
---
## Quick start
```python
from ctransformers import AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("npvinHnivqn/GGUF-metamath-llemma", 
                                                   model_file="metamath-llemma.gguf", 
                                                   model_type="llama", gpu_layers=0,
                                                   context_length=768)
model('''AI will ''', temperature=0.1)
```