Update README.md

README.md

@@ -7,6 +7,9 @@ tags:
 base_model:
 - NousResearch/Hermes-2-Pro-Llama-3-8B
 - cognitivecomputations/dolphin-2.9-llama3-8b
+license: apache-2.0
+language:
+- en
 ---
 
 ![](https://raw.githubusercontent.com/saucam/models/main/athena.png)
@@ -43,22 +46,62 @@ dtype: bfloat16
 ```python
 !pip install -qU transformers accelerate
 
-from transformers import AutoTokenizer
+from transformers import AutoModelForCausalLM, AutoTokenizer
 import transformers
 import torch
 
-model = "saucam/Athena-8B"
+model_name = "saucam/Athena-8B"
 messages = [{"role": "user", "content": "What is a large language model?"}]
 
-tokenizer = AutoTokenizer.from_pretrained(model)
-prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
-pipeline = transformers.pipeline(
-    "text-generation",
-    model=model,
-    torch_dtype=torch.float16,
-    device_map="auto",
-)
-
-outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
-print(outputs[0]["generated_text"])
+model = AutoModelForCausalLM.from_pretrained(model_name)
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+messages = [
+    {"role": "system", "content": "You are a sentient, superintelligent artificial general intelligence, here to teach and assist me."},
+    {"role": "user", "content": "Write a short story about Goku discovering kirby has teamed up with Majin Buu to destroy the world."}
+]
+
+device = "cuda"
+
+gen_input = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
+model_inputs = gen_input.to(device)
+model.to(device)
+
+# Generate response
+out = model.generate(model_inputs, max_new_tokens=750, temperature=0.8, repetition_penalty=1.1, do_sample=True, eos_token_id=tokenizer.eos_token_id)
+response = tokenizer.decode(out[0][model_inputs.shape[-1]:], skip_special_tokens=True, clean_up_tokenization_space=True)
+print(f"Response: {response}")
+```
+
+```
+Response: Goku stared at his radar in disbelief as he noticed an unusual energy signature. It was unmistakable - Kirby had teamed up with Majin Buu! The two villains were plotting to destroy the world.
+
+Without wasting any time, Goku set off on his flying nimbus cloud towards their location. As he traveled, he contemplated how these two beings could have possibly joined forces. After all, they came from completely different worlds; one was a mischievous and cute pink puffball, and the other was a malevolent and destructive monster. But alas, it seemed they shared a common goal: to bring about the end of everything.
+
+Upon arriving at their hideout deep within a dark cave, Goku couldn't help but feel a sense of unease. He cautiously approached them, taking care not to alert their sinister intentions. As he drew closer, he overheard their conversation.
+
+Kirby: "Majin Buu, together we can conquer the universe!"
+
+Majin Buu: "Yes, little Kirby. With your powers combined with mine, there's nothing that can stop us."
+
+Goku knew he couldn't allow this plan to come to fruition. He revealed himself to the duo, angering both of them.
+
+Kirby: "Ah, it's you, Goku! What do you want?"
+
+Goku: "I won't let you destroy the world."
+
+Majin Buu snickered, then said, "Foolish mortal, you cannot defeat us."
+
+The battle began between Goku and his new adversaries. Kirby used his incredible copy abilities along with his powerful inhalation move, while Majin Buu relied on his immense power and devastating attacks. The fight raged on for hours, and Goku seemed to be losing ground.
+
+Just when things looked hopeless, Goku remembered something - the Ultra Dragon Ball! If he could summon Shenron and wish for all life to be safe, maybe he could thwart their evil plans without destroying them.
+
+In a final burst of energy, Goku threw a Kamehameha at Majin Buu while calling out for the Ultra Dragon. To his surprise, the attack landed, and Shenron emerged from the resulting explosion.
+
+Goku: "Ultra Dragon, grant my wish! I wish for all life on Earth and the entire universe to be protected from Kirby and Majin Buu!"
+
+Shenron nodded, and a wave of golden light spread across the cosmos, encompassing every living being. When the light dissipated, Goku found that Kirby and Majin Buu were gone - they had been erased from existence by the power of the wish.
+
+With the threat neutralized, Goku returned to his daily life, knowing that peace would be preserved thanks to the Ultra Dragon's intervention. However, he couldn't help but wonder about the mysteries of the multiverse and why certain individuals like Kirby and Majin Buu were so hell-bent on destruction. For now, though, he would focus on training harder and keeping the universe safe from harm. Příběh končí. 
+
+The End.
 ```