iz2057 commited on
Commit
ffa6245
·
1 Parent(s): 14c5cd6

Updating model card with usage instructions

Browse files
Files changed (1) hide show
  1. README.md +22 -2
README.md CHANGED
@@ -50,8 +50,28 @@ We evaluated Llama3 8B SEA-Lionv2.1 SECURE on three benchmarks:
50
  Users are solely responsible for the deployment and usage of this model. While the model has undergone additional safety alignment, this does not guarantee absolute safety, accuracy, or reliability. Like all language models, it can generate hallucinated or misleading content, and users should independently verify outputs before relying on them. The authors make no warranties regarding the model's behavior and disclaim any liability for claims, damages, or other consequences arising from the use of the released weights and code.
51
 
52
  ## Usage
53
- SEA-LION can be run using the 🤗 Transformers library
54
- **\[TBC\]**
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
 
56
  ## The Team
57
  Isaac Lim, Shaun Khoo, Goh Jiayi, Jessica Foo, Watson Chua
 
50
  Users are solely responsible for the deployment and usage of this model. While the model has undergone additional safety alignment, this does not guarantee absolute safety, accuracy, or reliability. Like all language models, it can generate hallucinated or misleading content, and users should independently verify outputs before relying on them. The authors make no warranties regarding the model's behavior and disclaim any liability for claims, damages, or other consequences arising from the use of the released weights and code.
51
 
52
  ## Usage
53
+ Llama3 8B SEA-Lionv2.1 SECURE can be run using the 🤗 Transformers library
54
+
55
+ ```python
56
+ import transformers
57
+ import torch
58
+
59
+ pipeline = transformers.pipeline(
60
+ "text-generation",
61
+ model='govtech/llama3-8b-sea-lionv2.1-instruct-secure',
62
+ model_kwargs={"torch_dtype": torch.bfloat16},
63
+ device_map="auto",
64
+ )
65
+ messages = [
66
+ {"role": "user", "content": "Hello!"},
67
+ ]
68
+
69
+ outputs = pipeline(
70
+ messages,
71
+ max_new_tokens=256,
72
+ )
73
+ print(outputs[0]["generated_text"][-1])
74
+ ```
75
 
76
  ## The Team
77
  Isaac Lim, Shaun Khoo, Goh Jiayi, Jessica Foo, Watson Chua