Model Card for Model ID
Introducing Pixie Zehir Nano.
Excelling in writing.
A fine tune of Llama 3.2 3B on HQ DATAâ„¢ from Pixie Zehir.
Model Details
- Developed by: [Maani x BLNKBLK]
- Language(s) (NLP): [English]
- License: [Apache 2.0]
- Finetuned from model : [meta-llama/Llama-3.2-3B-Instruct]
Agreements
Model is created for research purposes.
Usage
!pip install -qqq transformers
import torch
from transformers import pipeline
pipe = pipeline(
"text-generation",
model="Maani/PXZNNO",
torch_dtype=torch.bfloat16,
device_map="auto",
)
prompt = "Write a haiku."
messages = [
{"role": "user", "content": prompt},
]
prompt = pipe.tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
enable_thinking=True # Switches between thinking and non-thinking modes. Default is True.
)
res = pipe(
prompt,
max_new_tokens=4096,
temperature=0.8,
top_p=0.95,
top_k=20,
min_p=0.1,
do_sample=True,
)
print(res[0]["generated_text"])
#sample of output
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
Enable deep thinking subroutine.<|eot_id|><|start_header_id|>user<|end_header_id|>
Write a haiku.<|eot_id|><|start_header_id|>assistant<|end_header_id|>
<think>
Okay, I need to write a haiku. Let me remember the structure. A haiku is a traditional Japanese poem with three lines. The syllable count is 5-7-5. The first line has 5 syllables, the second 7, and the third 5.
Hmm, what's a common haiku theme? Nature is often popular. Maybe something about seasons. Let me think of a season. Autumn? Leaves falling, that's a classic image.
First line: "Falling leaves dance" – that's 5 syllables. Leaves, falling, dance. Nice and simple.
Second line: "Whispers of autumn's sigh" – that's 7 syllables. Whispers, autumn's, sigh. It captures the gentle sound of falling leaves.
Third line: "Time's fleeting breath" – 5 syllables. Time's fleeting, breath. It's a metaphor for the passage of time.
Does that work? Let me check the syllable count again. Yes, 5-7-5. The imagery is cohesive, and it evokes a sense of time passing and the beauty of autumn. I think this works. Let me see if there's a better option, but I think this one is solid.
</think>
Falling leaves dance
Whispers of autumn's sigh
Time's fleeting breath
Thanks to mradermacher, You can find the GGUF quantized versions of earlier 1.8B Zehir nano at: mradermacher/PixieZehirNano-GGUF
- Downloads last month
- 7
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support