RocRacoon-3b Banner

RocRacoon-3b 🦝

RocRacoon-3b is a versatile language model designed to excel in creative writing, storytelling, and multi-turn conversations. Built on the Phi-3-mini-128k-instruct model, it has been fine-tuned to enhance its contextual understanding and generate more engaging and coherent responses.

Model Details πŸ“Š

Quantization

Model Architecture πŸ—οΈ

  • Base model: microsoft/Phi-3-mini-128k-instruct
  • Parameter count: ~3 billion
  • Architecture specifics: Transformer-based language model

Intended Use 🎯

RocRacoon-3b is designed for a wide range of natural language processing tasks, with a particular focus on article writing and topic based multi-turn conversations. It can be used for text generation, dialogue systems, and content creation.

Ethical Considerations πŸ€”

As a derivative of the Phi-3-mini model, RocRacoon-3b may inherit some biases and limitations. Users should be aware of potential biases in generated content and use the model responsibly, especially in sensitive contexts.

Performance and Evaluation

Comprehensive performance metrics for RocRacoon-3b are currently being compiled. Initial tests show improvements in coherence and creativity compared to the base model. Users are encouraged to contribute their findings and benchmarks.

Limitations and Biases

While efforts have been made to mitigate biases, the model may still exhibit some biases present in its training data. Users should critically evaluate the model's outputs and use them in conjunction with human judgment, particularly for sensitive applications.

Additional Information

For more details on the base Phi-3-mini-128k-instruct model, please refer to its model card and documentation.

How to Use

from transformers import AutoTokenizer, AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("aixonlab/RocRacoon-3b")
tokenizer = AutoTokenizer.from_pretrained("aixonlab/RocRacoon-3b")

prompt = "Write a short story about a clever raccoon"
input_ids = tokenizer(prompt, return_tensors="pt").input_ids

generated_ids = model.generate(input_ids, max_length=200)
generated_text = tokenizer.decode(generated_ids, skip_special_tokens=True)
print(generated_text)
Downloads last month
30
Safetensors
Model size
3.82B params
Tensor type
FP16
Β·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for aixonlab/RocRacoon-3b

Finetuned
(39)
this model
Quantizations
1 model