futureHQ commited on
Commit
8080564
·
verified ·
1 Parent(s): 7b01eeb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md CHANGED
@@ -1,3 +1,31 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+
5
+ #### How to use
6
+ You will need the transformers>=4.31
7
+ ```python
8
+ from transformers import AutoTokenizer
9
+ import transformers
10
+ import torch
11
+ model = "OpenGenerativeAI/FoundationModel-1.1B-LLM"
12
+ tokenizer = AutoTokenizer.from_pretrained(model)
13
+ pipeline = transformers.pipeline(
14
+ "text-generation",
15
+ model=model,
16
+ torch_dtype=torch.float16,
17
+ device_map="auto",
18
+ )
19
+
20
+ sequences = pipeline(
21
+ 'The FoundationModel project aims to pretrain a 1.1B Llama model on 3 trillion tokens.',
22
+ do_sample=True,
23
+ top_k=10,
24
+ num_return_sequences=1,
25
+ repetition_penalty=1.5,
26
+ eos_token_id=tokenizer.eos_token_id,
27
+ max_length=500,
28
+ )
29
+ for seq in sequences:
30
+ print(f"Result: {seq['generated_text']}")
31
+ ```