QuantFactory/ArliAI-Llama-3-8B-Formax-v1.0-GGUF

This is quantized version of OwenArli/ArliAI-Llama-3-8B-Formax-v1.0 created using llama.cpp

Model Description

Based on Meta-Llama-3-8b-Instruct, and is governed by Meta Llama 3 License agreement: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct

Formax is a model that specializes in following response format instructions. Tell it the format of it's response and it will follow it perfectly. Great for data processing and dataset creation tasks.

Base model: https://huggingface.co/failspy/Meta-Llama-3-8B-Instruct-abliterated-v3

Training:

• 4096 sequence length
• Training duration is around 2 days on 2x3090Ti
• 1 epoch training with a massive dataset for minimized repetition sickness.
• LORA with 64-rank 128-alpha resulting in ~2% trainable weights.

Suggested prompting strategy:

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

You are a [give it a role]. You are tasked with [give it a task]. Reply in the following format: [requested format of reply]<|eot_id|><|start_header_id|>user<|end_header_id|>

{{ user_message_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{{ model_answer_1 }}<|eot_id|><|start_header_id|>user<|end_header_id|>

{{ user_message_2 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Example prompt:

System prompt: Your task is to identify if any type of question is being asked by the user. If a question is being asked, respond 'YES'. If not, respone with 'NO'. Reply in the following format: {\n  \"response\": \"[YES or NO]\"\n}

User: You are an AI.

Response: {\n  \"response\": \"NO\"\n}

System: You are a professional writer. You should create captivating stories that are interesting to read. Reply with the following format:\n\nTitle: [Create a title for the story]\n\n Story: Under the sun of azgul, [continue story]

User: Create for me a story about an adventure in a fantasy world.

Response: Title: The Chronicles of Azgul: The Quest for the Starlight Crystal\n\nStory: Under the sun of Azgul, a land of ancient magic, a young apprentice named Elyria stumbled upon an ancient prophecy that would change her life forever. As she delved deeper into the mysteries of the ancient lore, she discovered that she was destined to wield the power of the Starlight Crystal, a relic rumored to hold the secrets of the universe.\n\nWith the guidance of her wise mentor, Lyra, Elyria embarked on a perilous journey to retrieve the crystal. Their quest took them across treacherous landscapes, through enchanted forests, and over treacherous mountain ranges. Along the way, they encountered formidable foes, including the dark sorcerer, Malakai, who sought to claim the crystal's power for himself.\n\nAs they navigated the challenges of their journey, Elyria and Lyra formed an unlikely alliance with a band of brave warriors, each with their own unique skills and motivations. Together, they battled fearsome creatures and overcame treacherous obstacles, driven by their determination to uncover the secrets of the Starlight Crystal.\n\nFinally, after many trials and tribulations, they reached the heart of the mystical realm, where the crystal awaited. But to claim it, Elyria would have to face her greatest challenge yet: a test of courage, wit, and wisdom. With the fate of Azgul hanging in the balance, Elyria rose to the occasion, harnessing the power of the Starlight Crystal to vanquish Malakai and shatter the darkness that had threatened to consume the land.With the crystal in hand, Elyria and her companions returned to Azgul, hailed as heroes by the people. But their journey was far from over. As they gazed up at the starry sky, they knew that there were still many mysteries to uncover, and that their adventures would continue to shape the destiny of Azgul.

System: Your are an intelligent AI assistant that can process texts. Always reply in json formatting when possible.

User: The following is a short story, identify all the characters in it.\n\nTitle: The Chronicles of Azgul: The Quest for the Starlight Crystal\n\nStory: Under the sun of Azgul, a land of ancient magic, a young apprentice named Elyria stumbled upon an ancient prophecy that would change her life forever. As she delved deeper into the mysteries of the ancient lore, she discovered that she was destined to wield the power of the Starlight Crystal, a relic rumored to hold the secrets of the universe.\n\nWith the guidance of her wise mentor, Lyra, Elyria embarked on a perilous journey to retrieve the crystal. Their quest took them across treacherous landscapes, through enchanted forests, and over treacherous mountain ranges. Along the way, they encountered formidable foes, including the dark sorcerer, Malakai, who sought to claim the crystal's power for himself.\n\nAs they navigated the challenges of their journey, Elyria and Lyra formed an unlikely alliance with a band of brave warriors, each with their own unique skills and motivations. Together, they battled fearsome creatures and overcame treacherous obstacles, driven by their determination to uncover the secrets of the Starlight Crystal.\n\nFinally, after many trials and tribulations, they reached the heart of the mystical realm, where the crystal awaited. But to claim it, Elyria would have to face her greatest challenge yet: a test of courage, wit, and wisdom. With the fate of Azgul hanging in the balance, Elyria rose to the occasion, harnessing the power of the Starlight Crystal to vanquish Malakai and shatter the darkness that had threatened to consume the land.With the crystal in hand, Elyria and her companions returned to Azgul, hailed as heroes by the people. But their journey was far from over. As they gazed up at the starry sky, they knew that there were still many mysteries to uncover, and that their adventures would continue to shape the destiny of Azgul.

Response: {\n  \"characters\": [\n    {\n      \"name\": \"Elyria\",\n      \"description\": \"A young apprentice who discovers she is destined to wield the power of the Starlight Crystal.\"\n    },\n    {\n      \"name\": \"Lyra\",\n      \"description\": \"Elyria's wise mentor who guides her on her journey.\"\n    },\n    {\n      \"name\": \"Malakai\",\n      \"description\": \"A dark sorcerer who seeks to claim the power of the Starlight Crystal for himself.\"\n    },\n    {\n      \"name\": \"Warriors\",\n      \"description\": \"A band of brave warriors who join Elyria and Lyra on their quest.\"\n    }\n  ]\n}