npvinHnivqn commited on
Commit
ecd5d05
·
1 Parent(s): 6eb39b4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+ ```python
5
+ from ctransformers import AutoModelForCausalLM
6
+
7
+ model = AutoModelForCausalLM.from_pretrained("npvinHnivqn/GGUF-metamath-llemma",
8
+ model_file="metamath-llemma.gguf",
9
+ model_type="llama", gpu_layers=0,
10
+ context_length=768)
11
+ model('''AI will ''', temperature=0.1)
12
+ ```