Updating model card with usage instructions
Browse files
README.md
CHANGED
@@ -50,8 +50,28 @@ We evaluated Llama3 8B SEA-Lionv2.1 SECURE on three benchmarks:
|
|
50 |
Users are solely responsible for the deployment and usage of this model. While the model has undergone additional safety alignment, this does not guarantee absolute safety, accuracy, or reliability. Like all language models, it can generate hallucinated or misleading content, and users should independently verify outputs before relying on them. The authors make no warranties regarding the model's behavior and disclaim any liability for claims, damages, or other consequences arising from the use of the released weights and code.
|
51 |
|
52 |
## Usage
|
53 |
-
SEA-
|
54 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
## The Team
|
57 |
Isaac Lim, Shaun Khoo, Goh Jiayi, Jessica Foo, Watson Chua
|
|
|
50 |
Users are solely responsible for the deployment and usage of this model. While the model has undergone additional safety alignment, this does not guarantee absolute safety, accuracy, or reliability. Like all language models, it can generate hallucinated or misleading content, and users should independently verify outputs before relying on them. The authors make no warranties regarding the model's behavior and disclaim any liability for claims, damages, or other consequences arising from the use of the released weights and code.
|
51 |
|
52 |
## Usage
|
53 |
+
Llama3 8B SEA-Lionv2.1 SECURE can be run using the 🤗 Transformers library
|
54 |
+
|
55 |
+
```python
|
56 |
+
import transformers
|
57 |
+
import torch
|
58 |
+
|
59 |
+
pipeline = transformers.pipeline(
|
60 |
+
"text-generation",
|
61 |
+
model='govtech/llama3-8b-sea-lionv2.1-instruct-secure',
|
62 |
+
model_kwargs={"torch_dtype": torch.bfloat16},
|
63 |
+
device_map="auto",
|
64 |
+
)
|
65 |
+
messages = [
|
66 |
+
{"role": "user", "content": "Hello!"},
|
67 |
+
]
|
68 |
+
|
69 |
+
outputs = pipeline(
|
70 |
+
messages,
|
71 |
+
max_new_tokens=256,
|
72 |
+
)
|
73 |
+
print(outputs[0]["generated_text"][-1])
|
74 |
+
```
|
75 |
|
76 |
## The Team
|
77 |
Isaac Lim, Shaun Khoo, Goh Jiayi, Jessica Foo, Watson Chua
|