File size: 461 Bytes
ecd5d05 0314072 ecd5d05 |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
---
license: mit
---
## Quick start
```python
from ctransformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("npvinHnivqn/GGUF-metamath-llemma",
model_file="metamath-llemma.gguf",
model_type="llama", gpu_layers=0,
context_length=768)
model('''AI will ''', temperature=0.1)
``` |