mrfakename/Apriel-5B-Instruct-llamafied

• Apriel 5B Instruct (Llamafied)
• Apriel 5B Base (Llamafied)

Apriel 5B Instruct (Llamafied)

An approximate conversion of Apriel 5B Instruct to the Llama format.

• No trust_remote_code required
• Compatible w/ popular fine-tuning frameworks
• Easier to run

Usage:

from transformers import pipeline
import torch

device = 'cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu'

pipe = pipeline('text-generation', model='mrfakename/Apriel-5B-Instruct-llamafied', device=device)

print(pipe(pipe.tokenizer.apply_chat_template([{'role': 'user', 'content': 'Hello'}], tokenize=False, add_generation_prompt=True))[0]['generated_text'])

License: MIT (same as the original Apriel 5B model)